Declarative web scraping

A Python module to bypass Cloudflare's anti-bot page.

CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)

Crawly, a high-level web crawling & scraping framework for Elixir.

Generate Free Edu Mail(s) within minutes

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.

Extract structured data from web sites. Web sites scraping.

Build Bots, Scrape a website or use an API to solve a problem.

OSINT tool - gets data from services like shodan, censys etc. in one app

A universal web-util for PHP.

Simple yet powerful automation stuffs.

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)

🧶 Extract data from any website without code, just clicks.

Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup

Library for Rapid (Web) Crawler and Scraper Development

An Aggregator Engine for searching and downloading movies free - NO ADs!

Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy.

Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel

The Kemono and Coomer Downloader simplifies downloading posts from Kemono and Coomer websites, allowing users to download individual or multiple posts, including entire profiles. It offers advanced features like downloading attachments, videos, and automatically organizing files.

CLI and GUI for OSINT. Are you very exhibited on the Internet? Check it! Twitter, Tinder, Facebook, Google, Yandex, BOE. It uses facial recognition to provide more accurate results.

Cloudflare Javascript & reCaptcha challenge (I'm Under Attack Mode or IUAM) solving / bypass .NET Standard library.

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Download YouTube video description and video comments without using the YouTube API.

A collection of intel and usernames scraped from various cybercrime sources & forums. DarkForums, HackForums, Patched, Cracked, BreachForums, LeakBase, XSS, Dread, & more

Scrape Algorithm Questions from leetcode and generate html and epub file

This repository provides usage examples for the Python module Newspaper3k.

A console application to scrape a valid watching links for any movie or series with exact season and episode number, you can also download a whole season with one click.

📰 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a few CSS selectors.

Structural analysis tools for complex web sites