Senior Python Data Scraping Engineer (Freelance)
$93,600–$93,600 year
Remote · Arizona, United States or South Carolina, United States
Job Summary
Senior Python Data Scraping Engineer (Freelance) for Tendem project. Part-time remote role within Mindrift’s hybrid AI + human system. Own end-to-end data extraction workflows across complex websites, leveraging Apify/OpenRouter and custom workflows to collect, validate, and deliver structured datasets. Ensure robust extraction from dynamic, JavaScript-rendered sites; enforce data quality; scale operations with batching/parallelization; monitor failures and adapt to site changes. Collaborate with Tendem Agents, apply strong Python scraping skills (BeautifulSoup, Selenium), handle anti-bot measures, and work with cloud (AWS) and Docker-based workflows. Proficiency with LLM frameworks (LangChain/OpenRouter); ability to troubleshoot independently; optional GitHub portfolio; English proficiency (B2+). Compensation up to $45/hour; estimated 10–20 hours/week during active phases.
Required Qualifications
- At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development
- Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus
- Strong experience in Python web scraping (BeautifulSoup, Selenium or similar) including dynamic content (JS, AJAX) and APIs via proxies
- Experience with data cleaning, normalization, and validation delivering structured datasets (CSV, JSON)
- Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
- Experience with anti-bot mechanisms and dynamic site structures at scale
- Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker)
- Self-directed work ethic and ability to troubleshoot independently
- A link to GitHub is a plus
- English proficiency: Upper-intermediate (B2) or above
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.