Data Scraping 1743
RemoteUnited States
Job Summary
Research and identify public and government data sources, then extract and normalize information from websites, APIs, feeds, and online repositories into predefined formats. Build reusable, maintainable scripts and workflows to automate data collection, ensuring consistent results across repeated executions. Troubleshoot acquisition issues, propose alternative approaches, and document methodologies, challenges, and metadata for downstream systems. Deliver sample outputs for review before processing larger datasets while maintaining version-controlled code repositories. This role focuses on solving complex data acquisition challenges for downstream systems, requiring strong problem-solving skills and independent work habits.
Required Qualifications
- Strong experience with web scraping and data extraction
- Practical programming experience using Python or similar scripting languages
- Experience working with HTML parsing
- Experience working with APIs
- Experience working with HTTP requests
- Experience working with FTP sources
- Experience working with structured or unstructured data
- Ability to evaluate, debug, and improve scraping solutions
- Strong analytical and problem-solving skills
- Experience building reusable automation workflows
- Familiarity with relational databases
- Familiarity with a normal Git workflow
- Strong documentation and communication skills
- Ability to work independently
- High attention to detail
- Commitment to data accuracy
- Monday to Friday - 12:00 PM – 8:00 PM CST
Desired Qualifications
- Experience working with government, regulatory, compliance, or public-sector datasets
- Experience with Playwright
- Experience with Selenium
- Experience with Puppeteer
- Experience with Scrapy
- Experience with similar scraping frameworks
- Experience with data versioning
- Experience with change detection
- Experience with document lineage
- Familiarity with AI-assisted development tools and workflows
- PostgreSQL
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.