GitHunt
SC

ScraperHub/gumtree-scrapers

Gumtree.com Search Listings and Product Details Pages Scrapers. Listing Scraper effectively handle pagination.

crawling-api-cta

๐Ÿ›’ Scrape Gumtree Data Easily with Python

A complete Python scraper to extract product listings and individual product details from Gumtree, including support for pagination and data export to CSV. Optionally, integrate with Crawlbase Smart Proxy to bypass rate limits and IP bans.

๐Ÿ“– Read the full tutorial โ†’ How to Scrape Gumtree Data Easily

๐Ÿ“Œ Features

  • Scrape Gumtree search listings (title, price, location, URL)
  • Scrape individual product pages (title, price, description, seller name, image URLs)
  • Handle pagination across multiple search result pages
  • Export data to CSV files
  • Optional integration with Crawlbase Smart Proxy for optimized scraping

๐Ÿงฐ Requirements

Install Python dependencies:

pip install requests beautifulsoup4 pandas

๐Ÿ” Gumtree Listings Scraper

File: gumtree_listings_scraper.py

This script collects product listings from Gumtree's search results and supports multiple pages.

python gumtree_listings_scraper.py

๐Ÿ“„ Sample output saved as: gumtree_listings.csv

๐Ÿ“ฆ Gumtree Product Details Page Scraper

File: gumtree_product_details_scraper.py

Scrape additional product details like description, seller name, and image URLs:

python gumtree_product_details_scraper.py

๐Ÿ“„ Sample output saved as: gumtree_product_data.csv

โšก๏ธ Boost with Crawlbase Smart Proxy (Optional)

To avoid rate limits, CAPTCHA challenges, or IP bans, you can proxy requests through Crawlbase Smart Proxy:

Example:

proxy_url = "http://_USER_TOKEN_@smartproxy.crawlbase.com:8012"
proxies = {"http": proxy_url, "https": proxy_url}

response = requests.get(url, proxies=proxies, verify=False)

๐Ÿชช Replace _USER_TOKEN_ with your Crawlbase token.