Principal Systems Software Engineer
$272,000–$431,250 year
On-siteChampaign, Illinois, United States or Santa Clara, California, United States
Job Summary
Develop Java, Scala, and CUDA/C++ libraries to accelerate DataFrames and I/O operations on common file formats like Parquet, ORC, and JSON. Enable interoperability with table formats such as Apache Iceberg and Delta Lake, and work with open source communities to enhance libraries like cuDF, CCCL, and UCX. Collaborate with distributed systems teams to craft solutions for large-scale processing challenges and build, test, and optimize libraries across different platforms. Provide recommendations on infrastructure, continuous integration, and testing strategies. This role supports NVIDIA's Apache Spark Acceleration group, integrating open source plugins with cloud services including AWS EMR and Databricks.
Required Qualifications
- BS, MS, or PhD in Computer Science, Computer Engineering, or closely related field (or equivalent experience)
- 15+ years of work experience in software development
- Outstanding technical skills in designing and implementing high-quality distributed systems
- Excellent programming skills in C++, Java, and/or Scala
- Ability to work with teams across organizational boundaries and geographies
- Familiarity with the open source data platform ecosystem (Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, etc.)
Desired Qualifications
- Meaningful contributions to the OSS community a plus
- Database query optimization is a strong plus
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.