Scrapy, a fast high-level web crawling & scraping framework for Python.

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

📊 Python's all-in-one framework for web crawling, scraping, and testing. Supports pytest. CDP Mode provides stealth. Over 200 runnable examples.

The All in One Framework to Build Undefeatable Scrapers

The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.

AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.

Scalable Python web scraping scripts for +40 popular domains

Learn everything web scraping with David Teather Codes on YouTube

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

Official replication package for IJFE (2026). Asynchronous ETL pipeline using GPT-4o to quantify investor distraction shocks from unstructured movie reviews.

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

httpmorph is a drop-in replacement for Python's requests library that uses a custom C implementation with BoringSSL instead of Python's standard HTTP stack.

This topic explains how to implement web scraping and python web development. Web scraping topics such as scrapy, beautiful soup, and others will be covered. A case study based on a Malaysian website.

qcrawl - fast async web crawling & scraping framework for Python.

Guide to Using Google Sheets for Basic Web Scraping

Official Python SDK for the ScrapeGraph AI API. Smart scraping, search, crawling, markdownify, agentic browser automation, scheduled jobs, and structured data extraction

A simple and easy to use web crawler for Python

Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.

CobWeb is a Python library for web scraping. The library consists of two classes: Spider and Scraper.

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio JS SDK for intelligent web data gathering.

Web scraping API for building AI applications.

No description provided.

Roadmap for Data Science circle associated with CAT Reloaded.

A short introduction to scraping with Python with given steps and an example scraper script.

Builds a Tagalog dictionary by collecting Tagalog words from tagalog.pinoydictionary.com

AI-powered deep research tool leveraging web scraping for cost-effective, comprehensive analysis. Open-source and API-cost free!

This Is A Web Scraping Projects With Covid-19 Data From 2 Very Popular & Authentic Websites

WatchTower - A platform to save your valuable time while staying updated in the Cyber realm.

A Python-based modular web scraping framework focused on efficient single URL crawling, supporting asynchronous processing, API services, and highly customizable spider modules.