DE II - Databricks Platform
$126,500–$208,700 year
On-siteHartford, Connecticut, United States or Saint Paul, Minnesota, United States
Job Summary
Build and operationalize complex data solutions on Databricks and AWS, incorporating Unity Catalog, PySpark, and Genie. Design and deploy data pipelines that capture, transform, and utilize data to support AI, machine learning, and business intelligence. Perform data and system analysis to resolve defects, assess incidents, and recommend data cleansing or quality solutions. Collaborate across teams to educate end users on complex data products while ensuring governance, security, and quality standards. Test data movement and transformation code to validate components and deliver complete solutions in small batches. Requires a Bachelor's degree in STEM and eight years of data engineering experience.
Required Qualifications
- Bachelor's Degree in STEM related field or equivalent
- Eight years of related experience
- Bachelor's degree in computer science, related STEM field, or its equivalent in education and/or work experience
- 4 additional years of data engineering experience
- Data Platform Technologies (Databricks, AWS)
- Databricks services – Unity Catalog
- Pyspark
- Genie
- Agile Product Development
- Cloud platforms
- programming languages
- modern software engineering practices
- Strong written and verbal communication skills
- Ability to lead team members
Desired Qualifications
- inquisitive attitude
- ability to translate stories found in data
- ability to design, build and deploy data solutions
- data governance
- data security
- data quality
- Cross-functional facilitation & alignment
- technical thought leadership
- Highly proficient use of tools, techniques, and manipulation including Cloud platforms, programming languages, and a full understanding of modern software engineering practices
- ability to deliver work at a steady, predictable pace
- ability to identify and negotiate important tradeoffs
- Demonstrated track record of domain expertise including understanding technical concepts necessary and industry trends
- in-depth knowledge of immediate systems worked on
- some knowledge of adjacent systems
- Strong problem solver
- creates innovate ways to resolve issues
- Ability to work collaborate well with team members and business partners
- proven track record of self-motivation in identifying opportunities and tracking team efforts
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.