Senior Python Data Scraping Engineer (Freelance)
$93,600–$93,600 year
Remote · United States or North Carolina, United States
Job Summary
Senior Python Data Scraping Engineer (Freelance) for Tendem project on Mindrift platform. Part-time remote role collaborating with Tendem Agents to deliver end-to-end data extraction workflows across complex websites using Apify, OpenRouter, and custom workflows. Responsibilities include ensuring complete coverage, accuracy, and delivery of structured datasets; handling dynamic, JS-rendered content; enforcing data quality through validation and cross-source checks; scaling scraping operations with efficient batching; monitoring failures and site changes. Requirements include 5+ years in data engineering or web scraping, strong Python scraping skills (BeautifulSoup, Selenium), experience with anti-bot mechanisms, cloud infra (AWS) and Docker, hands-on with LLM frameworks (LangChain, OpenRouter), and proficiency in delivering CSV/JSON outputs. This freelance, part-time position estimates 10–20 hours/week with compensation up to $45/hour. Proficiency in English (B2+) required. Notable tools/tech: Apify, OpenRouter, LangChain, Python, AWS, Docker, GitHub, JS/AJAX/dynamic content, data cleaning/validation, JSON/CSV outputs.
Required Qualifications
- At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required)
- Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields (a plus)
- Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
- Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
- Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
- Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
- Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
- Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
- Strong attention to detail and commitment to data accuracy
- Self-directed work ethic with ability to troubleshoot independently
- A link to GitHub is a plus
- English proficiency: Upper-intermediate (B2) or above (required)
- Project time expectations: around 10–20 hours per week during active phases
- Compensation: up to $45 per hour equivalent
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.