Software Engineer, Platform
On-site · San Francisco, California, United States
Job Summary
Skyway Software Engineer, Platform — Own and evolve the data infrastructure powering billing and usage data for a platform that helps AI labs and cloud providers forecast and manage compute. Build and maintain streaming and batch data processing for hundreds of millions of billing rows per customer, enrich and transform usage into contract-aware outputs, and implement the contract application engine. Develop expertise in provider billing schemas, diagnose data anomalies, design multi-provider data models, and ensure high-quality financial data with robust validation. Collaborate across backend, product, and customers to shape data contracts and APIs, while leveraging a stack including Python, SQL, Parquet, S3, Flask, and React. The role emphasizes data systems architecture, performance optimization, and end-to-end data quality in a small team that ships daily. Optional focus areas include data normalization across providers, cross-provider queries, and durable execution systems. Actual stack and tooling mentioned: Python, ClickHouse, Airflow, Parquet on S3, Flask, React; emphasis on data systems with strong judgment and the ability to work without a rigid spec.
Required Qualifications
- meaningful experience with data products, warehouses, lakehouses, OLAPs, ETL pipelines, and semantic systems
- experience with streaming or event-driven data as well as batch
- strong in Python and SQL
- comfortable with columnar databases and cloud storage
- ability to figure things out without a fixed spec
- familiarity with data quality practices and validation
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.