Workflow automation, bots, and scripting tools
846 repositories found
A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
Learn everything web scraping with David Teather Codes on YouTube
Undetected web-scraping & seamless HTML parsing in Python!
A very simple news crawler with a funny name
A simple web scraper to extract Product Data and Pricing from Amazon
🎯 哔哩哔哩(bilibili)评论区数据可视化分析软件-- up主可用于指导自己的题材选择，明确自己的粉丝群体
dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators
Build complex browser workflows visually and execute them via API.
Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.
一款适用于央视网的网络视频流解析处理工具
Discover and verify professional emails using names + domains
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
Scraping publicly-accessible Letterboxd data and creating a movie recommendation model with it that can generate recommendations when provided with a Letterboxd username
This repository contains a script to scrape Facebook Marketplace data using Playwright, BeautifulSoup and Streamlit.
Model Context Protocol (MCP) Server for Graphlit Platform
Library for Rapid (Web) Crawler and Scraper Development
Scrape, standardize and share public meetings from local government websites
A curated collection of the best free, freemium, and paid APIs for developers.
The only browser automation that bypasses anti-bot systems. AI writes network hooks, clones UIs pixel-perfect via simple chat.
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
Crawl telegra.ph searching for nudes!
Python's package to scrap Twitter's front-end easily
Provides a list of fresh, working proxy servers (HTTP, HTTPS, SOCKS4 & SOCKS5) with multiple formats available for download.
The unix-way web crawler
🌐 Repositório com o conteúdo (slides, exemplos, códigos) da série de vídeos no YouTube sobre Web Scraping com Python.
A huge collection of awesome beginner-friendly Python projects starting from very basics to advance. Prefect repository for learning python and enhancing your python programming skills.
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
OSINT tool to scrape names and usernames from large friend lists on Facebook, without being rate limited.
Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
An unofficial API for Quora.