Grupo QuintoAndar | Staff Data Engineer (Women Applicants Only)
On-siteSão Paulo, São Paulo, Brazil
Job Summary
Design, build, and maintain a robust, self-service, scalable data platform and end-to-end pipelines that empower analysts and scientists to drive strategic decisions. Create high-performance architectures, develop data modeling workflows, and troubleshoot inconsistencies by tracing data sources. Manage the full code development lifecycle, including monitoring, documentation, security, and SLO compliance, while aligning with stakeholders to propose extensible solutions. Conduct PoCs to select optimal tools and advocate for a data-driven culture across the organization. This role requires expertise in Big Data technologies like Spark and AWS, along with strong SQL and Python skills.
Required Qualifications
- Specialist in technologies, solutions, and concepts of Big Data (Spark, Hadoop, Hive, MapReduce) and multiple languages (YAML, Python)
- Experience with Airflow, Spark, AWS and Databricks
- Strong foundation in software engineering principles, with experience working on data-centric systems
- Experience with columnar storage solutions and/or data lakehouse concepts
- Proficiency in Python, or one of the main programming languages, and a passion for writing clean and maintainable code
- Strong knowledge in optimizing SQL query performance
- Experience in building multidimensional data models (Star and/or Snowflake schema)
- Understanding of the data lifecycle and concepts such as lineage, governance, privacy, retention, anonymization, etc.
- Knowledge in infrastructure areas such as containers and orchestration (Kubernetes, ECS), CI/CD strategies, infrastructure as code (Terraform), observability (Prometheus, Grafana), among others
- Proficiency in English - our code, documentation, tools, and materials are often structured in English
- Excellent communication skills, proactively sharing and collaborating with both technical and non-technical stakeholders to translate business needs into scalable data solutions
- Experience as a tech/project lead or similar
Desired Qualifications
- You have participated in building large-scale data platforms for big data sets and teams using Big Data technologies such as Spark, Trino, Hive, Atlas, Ranger, etc.
- Experience in building semantic layers
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.