Senior Data Engineer
On-site · Córdoba, Cordoba, Argentina
Job Summary
Senior Data Engineer to build and maintain the ML/AI data infrastructure powering Proofpoint's email security platform. Design and optimize scalable data pipelines on AWS/Azure/GCP, build Iceberg-based data lake tables, develop feature engineering frameworks for offline batch and online serving, and maintain training data pipelines with data lineage and reproducibility. Collaborate with data scientists, ML engineers, and security researchers to create data models and context stores for detection systems, ensuring data freshness, quality, and observability. Mentor junior engineers and contribute to an engineering-excellence culture. Implement scalable ETL/ELT pipelines, monitoring, and alerting across petabyte-scale datasets distributed across data centers.
Required Qualifications
- Several years of industry experience building and maintaining distributed data systems and high-scale data pipelines in a managed cloud environment (AWS / Azure / GCP)
- Experience with Spark, Flink, Dask, Ray, Beam, DataBricks Workflows or similar
- Strong proficiency in Python for developing production-grade data processing code
- Experience with Infrastructure-as-Code frameworks, particularly Terraform
- Hands-on experience with Apache Iceberg, Hudi, or DeltaLake for data lake schemas and versioning
- Experience with AWS Athena, Glue, or similar data query and cataloging services
- Experience with Apache Airflow or similar workflow orchestration tools
- Experience designing scalable ETL/ELT pipelines and data transformations
- Ability to translate data requirements into robust, production-grade data solutions
- Strong collaboration and communication skills
- Nice to have: experience with feature engineering frameworks and feature stores (e.g., Feast, Tecton)
- Familiarity with Kubernetes for containerized data workloads
- Background building data infrastructure for ML/AI applications
- Experience with data quality frameworks and observability tools
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.