Software Engineer, Batch Data
$176,000–$210,000 year
Remote · New York City, New York, United States or Seattle, Washington, United States
Job Summary
As a senior engineer on the Batch Data team, you will architect, design, and scale Tecton's core compute engines and storage architecture. Your responsibilities will include owning and leading significant technical domains, leading cross-functional projects, improving engineering practices, and developing a deep understanding of customer challenges in building ML systems. The role requires significant experience with large codebases in Python, Java, Kotlin, or Go, expertise in cloud-native Spark systems, and skills in query optimization and distributed systems.
Required Qualifications
- 8+ years of experience in building product software systems
- Experience working in large Python, Java, Kotlin, or Go codebases and running cloud-native Spark systems (e.g. AWS EMR, Databricks, GCP Dataproc)
- Experience in performance tuning of Spark, Ray, Maestro, or Airflow jobs
- Knowledge of data formats such as Parquet, Avro, Arrow, Iceberg, or Delta Lake, and object storage (e.g. S3, GCS)
- Expertise with cloud-scale query performance, query optimization, query planning, heuristic query execution techniques, and cost-driven optimizations
- Experience with internals of distributed systems, SQL/NoSQL databases, data lakes, or data warehouses
Desired Qualifications
- Excitement about coaching and mentorship of junior engineers
- Strong communication skills and ability to write detailed technical specifications
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.