Software Engineer, Data Platform Infrastructure (4-7 years)
On-site · Boston, Massachusetts, United States
Job Summary
Senior Data Platform Engineer to design and build a unified data fabric and lakehouse platform at a global investment firm. Lead architecture and modernization of data capabilities, specifically Apache Iceberg-based ingestion/egress, streaming, lifecycle management, and governance. Define compute architectures across stateful/stateless processing, enable real-time data movement with low latency, and extend platform to support AI/ML workflows (feature-ready pipelines, training/inference data services). Drive standards for data quality, observability, lineage, security, and operational excellence; mentor junior engineers and evaluate new technologies through PoCs. Role located onsite in Boston four days per week; responsibilities span platform design, strategy, and collaboration with enterprise stakeholders.
Required Qualifications
- Bachelor’s degree in CS/Engineering/IS
- 4+ years in data engineering, distributed systems, or platform engineering at senior technical leadership level
- Proven platform mindset with enterprise-scale data platforms or lakehouse experiences
- Deep hands-on experience with Apache Iceberg and modern open table formats
- Strong understanding of distributed compute architectures (stateful/stateless processing, orchestration, fault tolerance, performance optimization)
- Experience implementing event-driven/streaming architectures
- Experience enabling AI/ML platform capabilities (pipeline design, feature/data prep, integration with model development or production ML systems)
- Strong proficiency in Python and SQL; Java/Scala and modern data processing frameworks desirable
- Cloud-native/containerized experience, including orchestration, infra automation, and observability tooling
- Ability to operate as a senior technical decision-maker and influence architecture
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.