Contact person: Business Client

Phone:Show

Email:Show

Location: United States

Budget: Recommended by industry experts

Time to start: As soon as possible

Project description:
"Summary
I run [login to view URL], a site that tracks Social Security Disability judge statistics nationwide. The site used to automatically scrape the Social Security Administration’s publicly available monthly and quarterly data (approval rates, denial rates, wait times, office metrics, judge statistics, etc.). The scraping pipeline stopped working recently, and I need an experienced developer to repair or rebuild it.

What I need:

Review the existing scraper and identify why it stopped pulling SSA data.

Update or rebuild the scraping scripts (Python preferred) to extract SSA’s published tables, CSVs, PDFs, or HTML pages.

Parse and clean the data so it fits into the site’s existing database structure.

Auto-populate all current statistical fields, including:

Judge approval/denial percentages

Office-level approval rates

State and city-level stats

Average wait times

Any related monthly and quarterly SSA metrics

Reconnect the scraper output to the database so the site updates automatically.

Set up a reliable automation system (cron job or similar) to run on a schedule.

Add basic logging so I can see if something breaks in the future.

Important:
The site is already fully built. You do not need to redesign the dashboard or change how the front-end looks. I only need the automated data pipeline fixed so stats update correctly the way they used to.

Ideal experience:

Strong Python scraping skills (BeautifulSoup, Selenium, Requests, or Scrapy)

Experience scraping government or research-style datasets

MySQL experience

Comfort working on and improving an existing codebase

Ability to build a stable, maintainable and documented pipeline

This should be a focused project — likely 20–40 hours depending on what you find in the existing code.

If you have done similar scraping + automation projects, please include examples." (client-provided description)