Senior Data Engineer - Data Platform
On-siteSouth San Francisco, California, United States
Job Summary
Design and operate cloud services for data ingestion, transformation, validation, and serving across batch and near-real-time pipelines. Build orchestration patterns, shared libraries, and CI checks to standardize dataset publishing. Own lakehouse and warehouse foundations, including table management, schema evolution, partitioning, and lifecycle management. Establish data contracts, metadata, lineage, freshness, and quality checks tied to operational impact. Diagnose distributed-system bottlenecks to improve throughput, query performance, and storage efficiency. Partner with service, telemetry, analytics, and ML teams to align on durable platform interfaces. This full-time role is based in South San Francisco.
Required Qualifications
- 5+ years of professional software or data engineering experience
- production systems built primarily with Python or Rust
- Strong distributed-systems and data-systems foundations
- hands-on experience building and operating pipelines and data infrastructure at scale
- Experience with cloud infrastructure and production operations
- Experience with AWS
- experience with Kubernetes
- workflow orchestration tools such as Prefect or Airflow
- Experience with modern data warehouses
- preferably Snowflake
- lakehouse table formats
- data modeling
- transformation workflows such as dbt
- Demonstrated judgment on cost, performance, and reliability
- production guardrails
- backfills
- idempotency
- retries
- safe deployments
- data-outage runbooks
- Clear technical communication
- influence
- Experience with high-volume telemetry or sensor data
- data observability
- infrastructure-as-code
- safety-critical systems
- This is a full-time role based in South San Francisco
Desired Qualifications
- Experience with cloud infrastructure and production operations, ideally AWS and Kubernetes, plus workflow orchestration tools such as Prefect or Airflow
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.