Lead Data Engineer
RemoteColombia or Costa Rica
Job Summary
Lead and mentor a team of Data Engineers, driving technical excellence and code quality while owning end-to-end architecture and design of the data platform. Take full responsibility for solution delivery, from design to deployment, and define migration strategies from Snowflake and SSIS to Azure Databricks and DBT. Design scalable data pipelines and oversee Infrastructure as Code initiatives using Terraform to ensure consistency across environments. Act as the primary technical escalation point for complex issues and long-term platform stability, collaborating closely with stakeholders to deliver enterprise-grade solutions. Requires 8+ years of experience with Azure Databricks, DBT, Snowflake, Python, and Terraform. Remote role available in Costa Rica, Peru, Colombia, and Bolivia.
Required Qualifications
- 8+ years of experience in Data Engineering, including 2-3+ years in a Lead or Staff-level role
- Proven experience leading the design and implementation of large-scale enterprise data platforms
- Strong hands-on expertise with Azure Databricks, DBT, Snowflake, Python, and SQL
- Experience delivering large-scale data transformation programs involving thousands of DBT models and data pipelines processing terabytes of data daily
- Deep understanding of data architecture, data modeling, ETL/ELT frameworks, and distributed data systems
- Extensive experience with Terraform and Infrastructure as Code (IaC) principles
- Experience leading cloud migration initiatives, preferably from AWS to Azure
- Strong experience with Git-based version control and CI/CD pipelines
- Strong analytical and problem-solving skills with the ability to make architectural decisions and trade-offs
- Excellent communication and stakeholder management skills
- Experience working in insurance or financial services environments, including domains such as claims, underwriting, policies, and risk management
- Experience leading engineering teams and demonstrating measurable delivery success
- Experience managing and mentoring team members across different performance levels, driving growth, development, and continuous improvement
Desired Qualifications
- Experience implementing data governance, observability, and data quality frameworks
- Strong understanding of security and compliance standards within insurance or financial services organizations
- Experience working with real-time and streaming technologies such as Kafka, Event Hubs, or Delta Live Tables
- Familiarity with Lakehouse architectures and cloud cost/performance optimization strategies
- Experience operating in hybrid cloud or multi-cloud environments
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.