Contact person: Business Client

Phone:Show

Email:Show

Location: Washington, United States

Budget: Recommended by industry experts

Time to start: As soon as possible

Project description:
"We need an experienced developer to build a web scraping service in Python + Django.

Goal:
We provide a target URL (usually a real estate or car dealer listing page), and the system extracts the full listing details and returns them as clean structured JSON (also stored in a database). This is a general “URL to structured data” scraping framework (not an exact copy of any product).

Required stack:

* Python
* Django (REST API endpoints; admin panel is a plus)
* Playwright / Selenium / Scrapy / Requests (choose what fits)
* Proxy + anti-bot handling experience

Core features:

* Input: single listing URL or list/search page URL
* Output: JSON + DB storage + API response
* Typical fields:
* Title, price, currency
* Location (city/area/address if available)
* Description
* Images (all image URLs)
* Attributes/specs (rooms, sqm, year, brand/model, mileage, etc.)
* Contact details (if available)
* Listing ID / reference number
* Seller/agency/company name
* Source URL + domain
* Admin tools:
* Manage target websites / parsing rules
* Scrape logs (success/fail + error reason)
* Re-run jobs
* Scalability:
* Background queue (Celery preferred)
* Rate limiting + retries
* Proxy rotation + user-agent rotation

Important:

* Must have proven scraping experience (send demos/GitHub/screenshots)
* Must handle dynamic JS websites
* Clean code + setup documentation

Deliverables:

* Django project (API + scraper module)
* DB integration for scraped results
* Documentation: install/run + how to add a new website pattern
* Test run on our reference URLs (we will provide examples)

To apply, send:

* Proof of past scraping projects
* Tech choice (Playwright/Scrapy/etc.) and short reason
* Timeline in days

The project will be completely remote." (client-provided description)