Data Engineer II
On-siteGuadalajara, Jalisco, Mexico
Job Summary
Guide and front the design and development of ETL pipelines and processes while collaborating with data science and analytics professionals to prepare data for further use. Build, maintain, and optimize existing data architecture and infrastructure, enhancing data quality and integrity through pressure testing and validation. Spearhead the development and unification of multiple systems within a microservice-centric architecture, leveraging expertise in SQL, noSQL, and Python or Ruby. Requires a university degree in a technical field with 4+ years of experience and proficiency in AWS data warehousing and lakehouse concepts.
Required Qualifications
- University Degree in Computer Science, Data Science, Mathematics or a related field
- 4+ years of applicable experience
- Certification in one or more data management technologies or methodologies
- Expertise with both SQL and noSQL database solutions
- Experience working with both structured and unstructured data
- Knowledge of programming languages such as Python or Ruby
- Understanding of data warehousing concepts and tools in AWS or Azure
- Understanding of a data lakehouse architecture, design, and implementation
- Strong problem solving skills
- 2+ yrs of SQL experience
- 4+ years of programming experience using either Ruby, Python, or another scripting language
- Experience working within expansive AWS systems involving multiple groups of microservices
Desired Qualifications
- Masters Degree in Computer Science, Data Science, Mathematics or a related field
- 2+ years of applicable experience
- Experience unifying systems with similar but distinct approaches to data management
- Understanding of cloud computing and data management technologies in AWS (Sagemaker, Lambda, RDS, Redshift)
- Prior history working under Agile software development methods and tooling, such as Jira ticketing, Kanban process, etc.
- Exposure to data visualization or business intelligence tools is a plus (DOMO, Tableau, PowerBI)
- Experience working with version control systems such as GIT
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.