Azure Data Engineer
RemoteUnited States
United StatesRemoteFull TimeBachelors DegreeMedium
Full TimeBachelors DegreeMedium
Job Summary
Design and develop end-to-end data pipelines and data warehouses within Azure, managing extraction, ingestion, and transformation across SAP and non-SAP environments. Architect complex data models and execution pipelines for Azure ML, ensuring rigorous code review, performance tuning, and unit testing adherence. Support the full development lifecycle from SIT through UAT, including regression testing, data validation, and technical documentation for knowledge transfer. Mentor junior engineers and evangelize engineering standards while participating in Agile ceremonies. Lead large-scale distributed data architecture projects involving Python, SQL, and CI/CD tools, driving migrations from SAP to Azure Data Lakes.
Required Qualifications
- Bachelor degree required
- Strong experience working with Azure Platform & Azure BI Stack (Azure data factory / SQL / Azure Synapse /Azure SSAS /Azure DevOps /Azure Pipelines /Azure Data Lake)
- At least 3 years experience working with Azure Platform & Azure BI Stack
- Deep understanding relational database systems, modern Datawarehouse platforms like Azure SQL Synapse
- Experience building and automating data system components that enable - Data acquisition, cleansing, and persistence data engineering
- Proficient in writing complex SQL queries
- Solid understanding of key Business Intelligence and Analytics trends
- Experience with implementing companywide Business Intelligence and Analytics programs
- Understanding of agile software development methodologies
- 7 years of hands-on experience designing and implementing large-scale distributed data architecture for BI and OLTP systems
- 7 years of hands-on experience designing and implementing large-scale data pipelines
- 4 years of hands-on experience in Azure data services
- 4 years of hands-on experience with data integration using ETL / ELT tools
- Experience doing data migrations from SAP into Azure Datalakes using Theobald
- 4 years of hands-on experience with Python including object-oriented programming and unit testing
- Advanced experience with one or more Python parallel processing libraries
- Advanced data modeling experience
- Broad experience in Microsoft SQL technologies
- Broad multi-tenant data architecture and implementation experience across different data stores, messaging systems and data processing engines
- Experience with data integration through APIs, Web Services, SOAP, and/or REST services
- Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
- Knowledge of SOA and Micros Services Application Architecture
- Previous experience in Supply Chain related projects
- Bachelor's degree in CS or related field
- 7+ years of experience with designing and developing complex data architecture solutions
- 4+ years of design and development experience with Microsoft Azure data architecture and related solutions
- 4 years of hands-on experience with Python
Desired Qualifications
- Experience with Visualization tools like Power BI is a Plus
- Understanding of how to define and support a data governance framework
- Communications skills
- High level of English to mainten conversation with leaders and team members
- Leadership and proactive actitud
- Innovative and creative personality
- Smart thinker
- Previous experiences working in corporate companies with different work groups and authorization levels
- Strong team player with ability to collaborate with all levels of the organization
- Possess a drive towards forward progress and delivering results while taking responsibility
- Multi-tasker with ability to set and manage priorities
- Proactively and transparently communicate challenges and successes to product leadership
- Exhibit attention to detail
- Flexibility and willingness to help in other areas as priorities shift
- Ability to effectively operate with minimal supervision, but knowing how to keep leadership in the loop
- master's degree preferred
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.