Sr Data Engineer
$156,000–$156,000 year
On-siteGlendale, California, United States
Job Summary
Maintain, update, and expand existing Core Data platform pipelines while building and maintaining APIs for downstream applications. Develop real-time streaming data pipelines using Spark, Databricks, Delta Lake, and Snowflake. Collaborate with product managers, architects, and engineers to drive platform success, and develop documentation for internal and external standards regarding pipeline configurations and naming conventions. Ensure high operational efficiency and dataset quality to meet SLAs and project reliability for Engineering, Data Science, Operations, and Analytics teams. Work onsite 3-4 days a week in Glendale, CA.
Required Qualifications
- 7+ years of data engineering experience developing large data pipelines
- Proficiency in at least one major programming language (e.g. Python, Java, Scala)
- Hands-on production environment experience with distributed processing systems such as Spark
- Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
- Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Databricks, Big Query)
- Experience in developing APIs with GraphQL
- Advance understanding of OLTP vs OLAP environments
- Valid background check completed
Desired Qualifications
- Graph Database experience a plus
- Realtime Event Streaming experience a plus
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.