Senior Data Engineer
RemoteBrazil
BrazilRemotePart TimeSenior LevelTechnologyMedium
Part TimeSenior LevelMediumTechnology
Job Summary
Own end-to-end delivery of data pipelines and products from design through production support using Azure Databricks, DBT, and Python. Execute Snowflake to Azure migrations while building infrastructure-as-code with Terraform for scalable deployments. Implement data quality frameworks, observability, and governance standards to ensure reliable, compliant operations. Contribute to lakehouse architecture design and mentor junior engineers through code reviews. Monitor production systems for high availability and perform root cause analysis on incidents.
Required Qualifications
- Strong hands-on expertise with: Azure Databricks, DBT, Snowflake, Python and SQL
- Proven experience building and managing large-scale data pipelines and transformations
- Experience working with high-volume datasets (e.g., terabytes, complex data models, multiple pipelines)
- Solid understanding of: Data modelling and ETL/ELT frameworks, Distributed data systems and lakehouse architectures, Experience with Terraform and infrastructure-as-code principles
- Strong experience with CI/CD pipelines and Git-based version control
- Experience supporting production systems, including monitoring, alerting, and incident resolution
- Knowledge of data quality, testing, and observability frameworks
- Strong problem-solving and analytical skills
- Excellent communication skills with the ability to work across technical and non-technical stakeholders
Desired Qualifications
- Experience in insurance or financial services domains is highly desirable
- Experience with real-time/streaming technologies (Kafka, Event Hubs, Delta Live Tables)
- Knowledge of security, compliance, and data protection standards in regulated industries
- Experience with cost optimisation and performance tuning in cloud environments
- Exposure to multi-cloud or hybrid architectures
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.