AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.

The NSE has a website which displays the option chain in near real-time. This program retrieves this data from the NSE site and then generates useful analysis of the Option Chain for the specified Index or Stock. It also continuously refreshes the Option Chain and visually displays the trend in various indicators useful for Technical Analysis.

Model Context Protocol server that integrates AgentQL's data extraction capabilities.

Proxy List Scrapper

PhantomCrawler is a Python-based web testing and research tool that simulates website interactions from multiple proxy IP addresses to analyze traffic behavior, access controls, and response patterns under different network conditions.

All-in-one Web Scrapper for Python

Unofficial python api for Erowid, PsychonautWiki and AskTheCaterpillar

Builds a Tagalog dictionary by collecting Tagalog words from tagalog.pinoydictionary.com

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

🍀 Scraps data from Leafly and collects amazing weed-based meta-data.

Evaluate JavaScript on a URL through headless Chrome browser.

Unoffical api to get comic books from various publishers. Published on NPM !

This repository contains the code for completely scraping the yellow pages website to get the details of all the categories from all the cities in America and then turning all of the data into an api to be used later.

Library that retrieves public data from sololearn.com

AgentQL's integrations with workflow automation tools and AI agent frameworks let you extract structured data from web pages using queries or natural language and interact with the web with Playwright. Resilient, fast, and AI-ready.

This Python script automates interactions with LinkedIn Sales Navigator using Selenium WebDriver. It can log into LinkedIn, navigate through lists of prospects, send messages, and manage contacts based on specific criteria.

This Is A Web Scraping Projects With Covid-19 Data From 2 Very Popular & Authentic Websites

Get all the resources like Notes and Notebooks provided in CampusX Courses.

I was a little lazy in downloading the series I wanted. So I made it automatic.

Navega pela API do Portal BNMP coletando dados

This Repository is for scraping jobs from Indeed

An open-source dataset download tool to obtain copyright-free videos from various free video websites.

Silica-X is an extensible OSINT and digital footprint intelligence framework built in Python. It enables cross-platform identity discovery, domain and infrastructure reconnaissance, signal fusion, entity correlation, and exposure risk analysis across 70+ online platforms.

A .NET 8.0 C# WPF desktop application for web scraping data into structured databases with a modern UI, comprehensive logging and optimized high performance.

🤖 An RPA-based tool for extracting information over JUCESP.

Real-world AI agents that think, search, write, and build - powered by LangGraph and modular LLM

Repository designed to help freshers easily grasp the basics of web scripting, offering simple guides and examples to build a strong foundation.

How to scrape the Rotten Tomatoes website and extract metadata from actor and movie pages.

⚡ Lightning-fast Python image scraper | Download 10K+ images/min from any website | Smart filtering | Async | No duplicates | 100% automated

This repository contains a project to analyze customer feedback data for British Airways (BA) and uncover insights about the airline. It includes code, data, and documentation for data scraping and preparation, data analysis, and presentation of results and recommendations.