Senior Python Data Scraping Engineer (Freelance)
$93,600–$93,600 year
Remote · New York City, New York, United States or Queens, New York, United States
Job Summary
Senior Python Data Scraping Engineer (Freelance) for Tendem project on Mindrift's hybrid AI + human system. Part-time remote role responsible for owning end-to-end data extraction workflows across complex websites, leveraging Apify/OpenRouter, ensuring data quality, handling JavaScript-rendered content, and scaling scraping operations for large datasets. Collaborate with Tendem Agents to deliver structured datasets (CSV/JSON) with accurate validation, while applying Python-based tooling (BeautifulSoup, Selenium) and AI-assisted workflows. Estimated 10–20 hours/week with compensation up to $45/hour equivalent.
Required Qualifications
- At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development
- Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related fields is a plus
- Strong experience in Python web scraping (BeautifulSoup, Selenium or similar) including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
- Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
- Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON)
- Experience with anti-bot mechanisms and dynamic site structures at scale
- Experience with cloud infrastructure (AWS or equivalent) and Docker
- Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar)
- Self-directed work ethic with ability to troubleshoot independently
- GitHub link is a plus
- English proficiency: Upper-intermediate (B2) or above
- Project time expectations: around 10-20 hours per week during active phases
- Compensation: up to $45 per hour equivalent
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.