Get clean data from tricky documents, powered by vision-language models ⚡

source for Open States scrapers

A set of spiders and scrapers to extract location information from places that post their location on the internet.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.

🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.

Scrape Telegram group members (hidden members also) and add them to yours.

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

A framework for creating semi-automatic web content extractors

Python scripts for building 'Short Jokes' dataset, featured on Kaggle

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Scraply a simple dom scraper to fetch information from any html based website

Scraper for Google Maps "Popular Times" for place entries

Web based UI to make processing scraped data from real estate websites super simple

A Python scraper for Tokopedia that supports filtered product search, detailed product information, and customer reviews with accurate mobile pricing and Jupyter Notebook compatibility.

A Elegant Fast Multi Threaded Bypass Bot for Bigger Deeds. Try Now !!

Official source repository for Kodi scraper add-ons

A basic python 3 based web scraper for extracting reviews from Amazon. Built using Selectorlib and requests

CLI OSINT app that can fetch data from Instagram's Web API without authentication.

Simple library which helps you to retrieve the source of various video streaming sites.

Scrape ETF data for free - the unofficial python wrapper for ETFDB

Library for scraping websites or apis at any scale

An Unofficial Pitchfork Music API client for Node.js

Using Apache Airflow to schedule web scrapers

📈 A visual & terminal based web scraper

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis

In this guide on how to web scrape with Selenium, we will be using Python 3. The code should work with any version of Python above 3.6

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

📝 Resources for web scraping with node.js

Board game data scraper

This Python code scrapes Google search results then applies sentiment analysis, generates text summaries, and ranks keywords.