Senior Python Data Scraping Engineer (Freelance)
Remote · Australia
Job Summary
Senior Python Data Scraping Engineer needed for freelance Tendem project within Mindrift. In this role, you’ll own end-to-end data extraction workflows across complex websites, leverage internal tools such as Apify and OpenRouter alongside your own workflows, and ensure reliable extraction from dynamic, JavaScript-rendered sources. You’ll enforce data quality through validation checks and cross-source consistency controls, scale scraping operations with efficient batching, monitor failures, and collaborate with Tendem Agents to deliver structured datasets (CSV, JSON) for AI-assisted workflows. This is a part-time remote opportunity requiring hands-on web scraping, data extraction, and processing experience, with a focus on accuracy, reliability, and independent problem-solving.
Required Qualifications
- At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required).
- Strong experience in Python web scraping (BeautifulSoup, Selenium or similar) including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
- Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
- Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
- Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
- Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
- Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
- Self-directed work ethic with ability to troubleshoot independently
- A link to GitHub is a plus
- English proficiency: Upper-intermediate (B2) or above (required)
- Project time expectations: around 10–20 hours per week during active phases
- Compensation: Up to $45 per hour equivalent
Desired Qualifications
- Strong experience in Python data scraping
- Experience with Apify and OpenRouter
- Proficiency with BeautifulSoup, Selenium or similar
- Experience handling dynamic JS/AJAX content
- LLM frameworks (LangChain, OpenRouter)
- Cloud and containerization (AWS, Docker)
- data cleaning, normalization, and validation
- English proficiency at least B2
- Self-directed and able to troubleshoot independently
- GitHub portfolio a plus
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.