Principal Data Engineer
RemoteCosta Rica or San José, San José, Costa Rica
Job Summary
Build and maintain scalable data pipelines using DBT and Astronomer/Airflow for batch and incremental processing. Develop modular DBT transformation layers with robust testing, orchestrate end-to-end workflows using Cosmos to trigger DBT models as native Airflow DAGs, and design Snowflake schemas optimized for cost and performance. Enforce data quality standards through DBT tests and pipeline observability while writing clean, well-tested Python and SQL code. Lead and mentor a team of data engineers, contributing to sprint planning and architectural decisions. This Principal Data Engineer role requires 5+ years of experience in the modern cloud stack and focuses on building robust, scalable solutions within an agile, collaborative environment at Confiz.
Required Qualifications
- 5+ years of hands-on experience in the modern cloud data stack
- Bachelor's in Computer Science or a related discipline
- Databricks & PySpark: Delta Lake, batch and streaming workloads, cluster and cost optimization
- DBT (Core & Cloud): Advanced data modelling patterns, incremental strategies, custom tests, and CI/CD integration
- Astronomer / Airflow: DAG authoring, Cosmos for DBT orchestration, and pipeline observability
- Snowflake: Data modelling, query performance tuning, access control, and cost governance
- Python and SQL: Strong programming skills with a focus on modular, maintainable, and testable code
- Cloud platform: Hands-on experience with Azure or AWS
- Agile & CI/CD: Comfortable working in agile teams with a CI/CD development mindset
Desired Qualifications
- passionate about building robust, scalable data solutions
- thrives in agile, collaborative environments
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.