10 results for “topic:scrapy-extension”
A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
使 scrapy 开发不用在意 item,pipeline,middleware 等通用场景下模块的编写,解放开发者的双手。
🕶 Awesome list of Scrapy tools and libraries
scrapy 常用爬网必备工具包
A Scrapy extension to log items coverage when the spider shuts down
[MIRROR OF https://codeberg.org/sp1thas/scrapy-folder-tree] A scrapy pipeline which stores files using folder trees.
A Scrapy extension for sending notification to Slack channels
No description provided.
将 Spider Stats 存储到 MongoDB 的扩展,可以用于爬虫监控和统计
A Python library that acts as a middleware for Scrapy, a popular web scraping framework. This middleware integrates with the Ujeebu API to provide additional functionality to your Scrapy spiders