Staff Software Engineer, Data Platform
$191,000–$299,000 year
RemotePittsburgh, Pennsylvania, United States or Fremont, California, United States
Job Summary
Design and maintain scalable data pipelines for ingesting telemetry, logs, and sensor data from a fleet of humanoid robots operating in warehouses and manufacturing facilities. Develop data ingestion agents running directly on robot software to handle high-volume data in low-connectivity environments, while optimizing transmission protocols and formats for storage and query. Implement observability systems using tools like fluentbit and OpenTelemetry to enable real-time monitoring of fleet operations, and build solutions to prepare high-velocity data for analysis using Spark, Kafka, and AWS services. This fully remote role offers a base salary range of $191,000–$299,000 USD, with options for hybrid work from Salem, OR, Pittsburgh, PA, or Fremont, CA. The team contributes directly to improving robot performance and scaling cloud-based systems for fleet-scale automation.
Required Qualifications
- 5+ years of strong experience in building and scaling cloud-based data platforms with familiarity in cloud providers like AWS, GCP or Azure
- Proficient in big data frameworks like Spark, Kafka, Beam, Flink etc
- Familiarity with OSS data formats like Parquet, Arrow, Iceberg and protocols like Avro and Protobuf
- Experience with observability tools(e.g. OpenTelemetry, Prometheus etc) and implementing metrics, tracing and logging systems
- Proficiency in languages like Java, Scala (any JVM), or Python and a solid understanding of distributed systems and microservices architectures
- current authorization to work in the United States
Desired Qualifications
- Experience with Robotics, Autonomous Vehicles, or other sensor heavy workloads
- Knowledge of IoT systems, edge computing or working with embedded devices
- Data catalog experience (Datahub, Amundsen, Databricks Unity Catalog)
- Experience with Databricks
- Experience with Kubernetes
- Experience with Bazel/Blaze or other build systems
- Experience with C++, Rust
- Experience with robot data formats like mcap, ROS etc and data playback and visualization tooling like Rerun etc
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.