Data Engineer | BEES Personalization
$80,000–$120,000 year
On-site · Campinas, São Paulo, Brazil
Job Summary
As a Data Engineer at AB InBev's BEES Personalization team, you will implement ETL/ELT solutions and data integration between various systems. You will design, implement, and maintain data pipelines to ingest, store, and process large volumes of data. The role requires collaboration with teams to ensure data security and compliance, and involves optimizing the performance and scalability of data processing systems. Key qualifications include a Bachelor's degree in a related field and proficiency in programming with Python, PySpark, Scala, and SQL. You will be applying knowledge of data pipelines, cloud services, and data modeling techniques.
Required Qualifications
- Bachelor's degree in Computer Science, Computer Engineering, Information Systems, Systems Analysis and Development, or similar
- Intermediate English
- Apply knowledge of data pipeline concepts and tools to implement data transformation, cleaning, and aggregation tasks
- Use data pipeline frameworks and libraries to automate data processing tasks and optimize workflows
- Follow best practices for developing data pipelines, including version control, testing, and thorough documentation
- Apply programming skills in Python, PySpark, Scala, and SQL to effectively manipulate and transform data
- Understand and utilize cloud computing platforms and services offered by providers such as AWS, Azure, and Google Cloud
- Develop data pipelines using orchestration frameworks (e.g., Apache Airflow, Luigi, Mage, Databricks Workflows), integrating with PySpark and/or Scala as needed
- Understand and apply software design principles to data engineering projects
- Apply data modeling techniques to design efficient and scalable data models
- Optimize PySpark and SQL query performance, considering data volume, query complexity, and system resources
- Use data tools for ingestion, transformation, analysis, and visualization.
Desired Qualifications
- Develop and maintain APIs for data exchange between applications.
- Experience with cloud computing platforms (AWS, Azure, Google Cloud) and their services.
- Use automation frameworks and tools such as Azure DevOps, Terraform, and GitHub Actions.
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.