Senior Data Engineer (Streaming + AI Systems)
$150,000–$150,000 year
On-siteConcord, Ontario, Canada
Job Summary
Architect and operate real-time and batch data pipelines using Kafka, Spark, and the AWS ecosystem to support operational intelligence and predictive modeling. Lead the evolution of a scalable lakehouse architecture while designing end-to-end ML pipelines that include feature engineering and real-time inference. Apply statistical methods such as time-series analysis and anomaly detection to high-impact business problems, partnering with stakeholders across operations, finance, and product to translate requirements into robust systems. Own infrastructure design using Terraform to ensure reproducibility and scale, driving performance, reliability, and observability across all data systems.
Required Qualifications
- Proven experience building and scaling data platforms in production environments
- Deep expertise in streaming systems and distributed data processing
- Strong system design skills with the ability to operate at both architecture and implementation levels
- Experience owning ML/data pipelines end-to-end, including production deployment
- Solid grounding in statistical modelling and real-world applications
- AWS (Glue, Lambda, ECS, S3, and related services)
- Apache Spark + lakehouse frameworks (Delta or equivalent)
- Kafka / streaming architectures
- Terraform (Infrastructure as Code)
Desired Qualifications
- A bias toward ownership, pragmatism, and building systems that actually get used
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.