Web Scraping Developer
RemoteMalta
MaltaRemoteFull TimeMid LevelSmall
Full TimeMid LevelSmall
Job Summary
Design, develop, and maintain web scraping and automation solutions that interact with websites, APIs, email systems, and external platforms to collect affiliate and market intelligence data. Extract, transform, and load (ETL) this data into the company's centralized data warehouse while monitoring infrastructure for reliability and scalability. Analyze target system changes and anti-bot mechanisms to adapt scraping strategies, collaborating with internal teams to define data collection requirements and optimize pipelines. Utilize Python, Docker, AWS, and PostgreSQL to build integrations across third-party systems.
Required Qualifications
- Strong proficiency in Python
- Experience using UV for Python dependency and environment management
- Daily development experience in Linux environments
- Solid knowledge of PostgreSQL
- Experience with Docker
- Experience working with AWS services
- Proficiency with Git, particularly GitHub
- Hands-on experience with browser automation frameworks: e.g., Selenium
- Experience with HTTP clients: e.g. requests
- Strong understanding of: CSS Selectors and XPath
- Strong understanding of: Proxy rotation and management
- Strong understanding of: JavaScript injection and DOM manipulation
- Strong understanding of: Browser fingerprint spoofing and rotation
- Strong understanding of: Scraping dynamic and JavaScript-heavy websites
Desired Qualifications
- Experience bypassing anti-bot and anti-scraping systems
- Familiarity with advanced browser evasion techniques and detection avoidance strategies
- Experience with: CAPTCHA solving services
- Experience with: Network request analysis and reverse engineering
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.