Lead Data Engineer (P4519)
$125,000–$207,000 year
On-siteCincinnati, Ohio, United States
Job Summary
Design and implement Databricks-based solutions to ingest, store, transform, and distribute big data on Azure Cloud using Spark, Python, and SQL. Lead design and development of REST APIs hosted in Kubernetes while executing unit and integration testing. Take ownership of features through the entire SDLC, developing business domain understanding and setting technical strategy in partnership with Data Science, Product, and Architecture teams. Provide mentoring to junior resources and oversee blended offshore/onshore engineering teams. Collaborate with senior resources to ensure consistent development practices and drive process improvements. Follow a 5-day in-office work schedule within an Agile environment utilizing Big Room Planning.
Required Qualifications
- Bachelor's degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program
- 5+ years proven ability of professional data development experience
- Strong understanding of Agile Principles (Scrum)
- 5+ years proven ability of developing with Spark (Databricks, PySpark)
- Full understanding of ETL concepts and data warehousing concepts
- 3+ year developing experience with Python
- 1+ year developing experience with REST APIs
- 1+ year experience with Kubernetes
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.