Senior Data Engineer (Machine Learning-focus)
$80,000–$90,000 year
Remote
Job Summary
Architect, scale, and maintain the data infrastructure for real-time and batch ML workflows, ensuring data availability through processing, storage, aggregation, and API development. Streamline data processes by integrating testing, monitoring, alerting, and error recovery while designing a feature store for centralized feature discovery and serving. Build and optimize highly scalable pipelines using Apache Airflow and Apache Spark, focusing on reliability and cost-efficiency. Contribute to innovation by turning academic ideas into production-grade solutions and leverage AI coding tools to accelerate development cycles. Drive best practices for data quality, CI/CD, and technical documentation while mentoring peers and identifying infrastructure bottlenecks. Join a high-performing team delivering efficient, scalable systems that influence billions of real-time decisions daily.
Required Qualifications
- Proven track record as a Data Engineer
- Focus on MLOps and production-related challenges
- Hands-on expertise with Apache Spark
- Hands-on expertise with Apache Airflow
- Fluent in English
- Ability to articulate complex architectural choices to both technical and non-technical stakeholders
- Residency in the European Union
- Legal authorization to work in the European Union
Desired Qualifications
- Experience with Kafka streaming
- Experience with Kubernetes
- Good knowledge of AWS
- Hands-on experience with Python
- Hands-on experience with Java/Scala
- Experience with tabular data for classification problems
- Experience with deep learning
- Experience building or maintaining feature stores
- A "Product Owner" mentality for data
- Notions of French
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.