Data Engineer III (Databricks)
On-siteDublin, Leinster, Ireland
Dublin, Leinster, IrelandOn-siteFull TimeFinancial ServicesEnterprise
Full TimeEnterpriseFinancial Services
Job Summary
Develop workflows and ELT pipelines using Python and Databricks, supporting review of controls to ensure sufficient protection of enterprise data. Implement data security using entitlements frameworks and update logical or physical data models based on new use cases. Utilize SQL frequently and understand NoSQL databases while leveraging AWS Cloud Services for developing, deploying, and managing applications at scale. This role requires formal training or certification on software engineering concepts and three years of applied experience.
Required Qualifications
- Formal training or certification on software engineering concepts
- 3 years applied experience
- Good working knowledge of AWS
- Good working knowledge of Databricks
- Good working knowledge of Python
- Experience across the data lifecycle
- Advanced at SQL, including joins and aggregations
- Working understanding of NoSQL databases
- Significant experience with statistical data analysis
- Ability to determine appropriate tools and data patterns for analysis
- Utilize AWS Cloud Services for developing, deploying, and managing applications at scale
- Good understanding and working knowledge of software development lifecycle tools used for configuration management
- Good understanding and working knowledge of CI/CD pipelines
- Good understanding and working knowledge of unit testing
- Good understanding and working knowledge of regression testing
- Good understanding and working knowledge of performance testing
Desired Qualifications
- MLOps skills
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.