Azure Data Engineer - Remote, Latin America
Remote · Curitiba, Paraná, Brazil
Job Summary
Azure Data Engineer (Remote, Latin America) focusing on designing, developing, and maintaining ETL data pipelines and data warehousing solutions using Python (PySpark) and Azure Synapse Analytics. Collaborate with data scientists and analysts to deliver high-quality data for insights, build scalable pipelines, ensure data quality, and optimize performance in an Azure Synapse environment. Responsibilities include developing ETL processes, data modeling, implementing data fabric concepts (data lakes, delta lakes, lakehouses, data cataloging), monitoring pipelines, and ensuring security/compliance. Strong SQL, SparkSQL, and MS SQL skills, experience with REST APIs/CSV data sources, and familiarity with Git/Azure DevOps and Agile methodologies are required. Proficiency with Notebooks, Pipelines, and Key Vault in Azure Synapse is highly valued.
Required Qualifications
- Bachelor’s degree in Computer Science, Information Technology, or a related field; or equivalent work experience, with certifications related to data engineering or data science (e.g. Azure Data Engineer) being a plus.
- Proven experience in ETL data engineering with significant expertise in using Python (PySpark) to perform data extraction, transformation, and loading from REST APIs, SQL database tables, and CSV files.
- Proficiency in using Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
- Demonstrated ability to write complex SQL queries, optimize query performance, and work with both SparkSQL and MS SQL to effectively extract, transform, and load data.
- Knowledge of data integration best practices and tools.
- Experience with version control systems, such as Git (Azure DevOps).
- Strong problem-solving and analytical skills, with a keen attention to detail.
- Excellent communication skills, both verbal and written, with the ability to work collaboratively in a team environment with shifting priorities.
- Familiarity with big data technologies, machine learning, and data analysis preferred.
- Experience with data visualization tools (e.g. Power BI, Tableau) and Agile Methodologies a plus.
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.