Senior Data Pipeline Engineer - Freelance (80-100%, remote/Zurich/Berlin)
HybridZürich, Zurich, Switzerland
Job Summary
Own, design, build, and operate Spark-based data pipelines from development through production and monitoring. Improve and productionize ML models for AdTech use-cases like lookalike and demographics modeling. Leverage LLM-based code assistants and test-automation tools to increase productivity and share workflows with the team. Profile, benchmark, and tune Spark workloads while introducing best practices in orchestration and observability. This 6-month freelance engagement (80-100% remote or Zurich/Berlin) supports the team during a crunch period driven by customer demand, with potential conversion to FTE.
Required Qualifications
- Bachelor/Master/PhD in Computer Science, Data Engineering, or a related field
- 5+ years of professional experience
- Expert-level Python and PySpark/Scala Spark experience
- Proven track record building resilient, production-grade data pipelines with rigorous data-quality and validation checks
- Data-platform skills: operating Spark clusters, job schedulers, or orchestration frameworks (Airflow, Dagster, custom schedulers)
- Freelancer status (≥ 80 %)
- Remote work capability (fully remote ± 4 h CET) or based in Zürich/Berlin office
Desired Qualifications
- Working knowledge of ML lifecycle and model serving
- Familiarity with techniques for audience segmentation or look-a-like modelling
- Rust proficiency
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.