A next-generation crawling and spidering framework.

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

简单易用的Python爬虫框架，QQ交流群：597510560

SpiderSuite releases, wiki and roadmap

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

天眼查爬虫&企查查爬虫，指定关键字爬取公司信息

ACHE is a web crawler for domain-specific search.

The simple, easy to use command line web crawler.

The unix-way web crawler

🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

旨在将网易云、酷狗、QQ、酷我等各音乐平台集于一体

A simple distributed crawler for zhihu && data analysis

Ignareo the Carillon, a web crawler/spider template of ultimate high concurrency built for leprechauns. Carillons as the best web spiders; Long live the golden years of leprechauns! (ISML=international saimoe; 2022 ISML is last ISML)

Web spider as a service, spider on serverless

Tool made to automate tasks of pentesting.

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

talospider - A simple,lightweight scraping micro-framework

网络爬虫模拟登陆bilibili 滑动验证码的破解 弹幕发送 2018-10-9

user profile of jiayuan.com

No description provided.

A simple trap for web crawlers

哔哩哔哩（https://www.bilibili.com ）读取楼层，发送评论，抢楼，抢沙发

2018年底到2019上半年，通过抓包工具发现🎦好看视频的参数签名漏洞，并成功利用刷金币兑换现金，持续半年。

A hybrid crawler designed for security scanning

Open WEB spider platform

web crawler allowing full page render crawl using HtmlUnit

web spider to scan UR avialbe room and output as csv

Code and slides for my class: Data Gathering & Wrangling

Use Word2vec model and LDA model for drug recommendation