ScraperHub/gumtree-scrapers
Gumtree.com Search Listings and Product Details Pages Scrapers. Listing Scraper effectively handle pagination.
๐ Scrape Gumtree Data Easily with Python
A complete Python scraper to extract product listings and individual product details from Gumtree, including support for pagination and data export to CSV. Optionally, integrate with Crawlbase Smart Proxy to bypass rate limits and IP bans.
๐ Read the full tutorial โ How to Scrape Gumtree Data Easily
๐ Features
- Scrape Gumtree search listings (title, price, location, URL)
- Scrape individual product pages (title, price, description, seller name, image URLs)
- Handle pagination across multiple search result pages
- Export data to CSV files
- Optional integration with Crawlbase Smart Proxy for optimized scraping
๐งฐ Requirements
Install Python dependencies:
pip install requests beautifulsoup4 pandas๐ Gumtree Listings Scraper
File: gumtree_listings_scraper.py
This script collects product listings from Gumtree's search results and supports multiple pages.
python gumtree_listings_scraper.py๐ Sample output saved as: gumtree_listings.csv
๐ฆ Gumtree Product Details Page Scraper
File: gumtree_product_details_scraper.py
Scrape additional product details like description, seller name, and image URLs:
python gumtree_product_details_scraper.py๐ Sample output saved as: gumtree_product_data.csv
โก๏ธ Boost with Crawlbase Smart Proxy (Optional)
To avoid rate limits, CAPTCHA challenges, or IP bans, you can proxy requests through Crawlbase Smart Proxy:
Example:
proxy_url = "http://_USER_TOKEN_@smartproxy.crawlbase.com:8012"
proxies = {"http": proxy_url, "https": proxy_url}
response = requests.get(url, proxies=proxies, verify=False)๐ชช Replace _USER_TOKEN_ with your Crawlbase token.