Scalable Python web scraping scripts for +40 popular domains

Free Facebook pages MetaData Scraping Library - Unlimited Calls

🕷 Automatically detect changes made to the official Telegram sites, clients and servers.

Lightning-Fast, Adaptive Web Scraping for Python

List of libraries, tools and APIs for web scraping and data processing.

End-to-End ETL Pipeline for Film Data Crawling from Ohitv

File Crawler index files and search hard-coded credentials

API to parse tibia.com content into python objects.

A simple web crawler bot written in Python that retrieves and saves the HTML content of a specified webpage.

a customized skyscanner for north-east asia flight tickets

Twitter Crawling is a tool that utilizes Twitter API to get tweets based on keywords searches

Instagram Crawler is a Python script to download posts from a specified Instagram account.

Advance information retrieval system that combines advanced indexing, machine learning, and personalized search to enhance academic research and document discovery.

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

A custom library that integrates Scrapy with Kafka.

Webcrawl is a Python web crawler that recursively follows links from a starting URL to extract and print unique HTTP links. Using 'requests and 'BeautifulSoup', it avoids revisits, handles errors, and supports configurable crawling depth. Ideal for gathering and analyzing web links.

crawling job list in hibrain. net

Python web crawler designed to scrape websites

Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.