Self-hosted webscraper.

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

A simple yet comprehensive web scraper for kenpom.com.

:briefcase: Given the Skill and the Location, this script will scrape the Indeed Indian website and present the matching job details.

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

📝 Resources for web scraping with node.js

Scala application that allows web crawling and web scraping of web pages given as input with the use of special rules passed to it through the use of a DSL.

A multi-threaded price comparison tool built with Java, MongoDB and Swing

Drinking coffee is my second favorite thing to do, web scraping will always be first.

A .NET 8.0 C# WPF desktop application for web scraping data into structured databases with a modern UI, comprehensive logging and optimized high performance.

Run Botasaurus in GitPod

This python web scraping script is use to download top 21 Bollywood songs of Today/Yesterday/Week/Month/All from www.mymp3song.site.

Run Python Selenium in GitPod

A personal projects that uses concepts like web scraping, database management and machine learning that scraps NBA stats basketball from basketball-reference.com, stores into a database and using the database predict who is going to win MVP for a given year

A collection of web scrapers

:video_game: A Gog.com downloader

Generate a list of file links you can feed to wget for easy downloading! Mainly used for spidering web folders with lots of files. Can even generate a sitemap.txt or XML file for your website!

A high-performance, professional web scraping engine designed to extract product data from any e-commerce platform with extreme speed and accuracy. Phase 1 Complete.

Web scraper to extract startup data from a list of Crunchbase URL's

A high-performance universal web scraper engineered for speed and precision. Extracts product data from any e-commerce platform with automated bypass and multi-format export. Phase 1 Complete.

Best Rotating Proxy & Scraping API Alternative. Python Example.

By scraping leads from Google Maps, you can build a database of potential customers who have shown interest in products or services related to your business. This data can be used for targeted marketing campaigns, email outreach, or sales prospecting.

A tutorial on Crawling the Web and Scraping off the Useful bits - without actually doing anything!

Web Scraper using Python

Small Python script to scrape product prices from hepsiburada.com

Scrapers to extract, process and compile COVID-19 data from Sheriff's Department websites

Glassdoor webscrape for Developer jobs in England

This is a Python based web scraper that scrapes a list of URLs from LeadersLeague.com website that stores email, first name, last name and other leads from the website automatically

🕷️ Crawl websites efficiently with this Bash script, producing a clean list of URLs while respecting `robots.txt` and staying within specified domains.