Senior Data Engineer
On-siteBucharest, București, Romania
Job Summary
Oversee Snowflake platform health, performance, and reliability by troubleshooting ingestion, transformation, and orchestration issues. Provide support to platform tenants on Snowflake and Apache Airflow, ensuring smooth operations across data pipelines. Develop and maintain an end-to-end testing framework to safeguard tenant flows while optimizing queries and storage for performance and cost efficiency. Automate operational tasks through GitLab CI/CD pipelines and contribute to a consistent release process. Document data architecture, pipeline processes, and best practices while collaborating with the Snowflake team to evaluate new tools. Actively support the release process to ensure high-quality platform delivery within the Concorde Program.
Required Qualifications
- 5+ years of working with Python
- 3+ years hands on data engineering experience for data warehouse solutions using Snowflake, SQL or similar
- Experience using Apache Airflow for workflow orchestration
- Hands on experience with building CI/CD pipelines using GitLab or similar tools
- Experience working with Agile Delivery teams (Scrum, Kanban) and JIRA
- Ability to build automated testing to test data pipelines
- Up-to-date knowledge of technology standards, industry trends, emerging technologies and software development best practices
- Design and development of automated data pipelines and data structures
Desired Qualifications
- Experience with managing infrastructure using terraform
- Experience with using dbt for data transformation and modelling
- Experience with kafka event streaming and messaging
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.