Staff Engineer, Data Platform
$192,000–$272,000 year
On-site · San Francisco, California, United States or Cambridge, Massachusetts, United States
Job Summary
Staff Engineer, Data Platform at Lila Sciences leads design and evolution of core data infrastructure for ingestion, storage, and serving data across scientific and ML workflows. Owns architecture decisions, patterns, and standards; mentors engineers; partners with ML researchers and lab scientists to translate requirements into durable platform capabilities; builds reliable pipelines from instruments, public datasets, and literature; operates and extends workflow orchestration systems for observability, fault tolerance, and reproducibility; defines data models, schemas, and data contracts; drives cross-functional data standards and integration patterns.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 8+ years as a software or data engineer with focus on data infrastructure
- Designed and shipped data platform components including ingestion frameworks, storage abstractions, and orchestration systems
- Fluent in Python and SQL; production-quality code
- Experience with relational and NoSQL databases, schema design, query optimization, and operating at scale
- Cross-functional collaboration with scientists, ML researchers, and engineers
- Experience with cloud infrastructure and containerized deployment (AWS, Kubernetes)
- Hands-on experience with modern table formats and open lakehouse patterns (Iceberg, Delta Lake, Hudi)
- Bonus: experience with Flyte, Airflow, Dagster; vector databases; RAG; AI-assisted tooling
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.