Software Engineer II (Backend + Data pipelines)
$126,000–$196,000 year
On-site · San Francisco, California, United States or Atlanta, Georgia, United States
Job Summary
We are seeking a Software Engineer II with strong backend development experience to design, build, and optimize distributed systems for extracting and processing metadata at scale. Responsibilities include leveraging LLMs for metadata integration, collaborating with cross-functional teams to implement scalable solutions, and ensuring data accuracy through automated monitoring. Candidates should have extensive experience in software engineering with proficiency in relevant programming languages and cloud infrastructure management.
Required Qualifications
- 5+ years of professional software engineering experience
- Proficiency in Python, Scala, Ruby, or similar languages
- Experience designing and building distributed systems at scale
- Hands-on experience building, deploying, and optimizing solutions using ECS, EKS, or AWS Lambda
- Experience with infrastructure-as-code tools like Terraform (or similar)
- Experience working with a public cloud provider (AWS, Azure, or Google Cloud)
- Familiarity with data processing frameworks like Spark or Databricks for large-scale workloads
- Proven ability to test, profile, and optimize systems for performance, scalability, and reliability
Desired Qualifications
- Experience working with LLMs or integrating ML models into production systems
Additional Requirements
- Employees must have their primary residence in or near specific cities listed in the job posting.
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.