Senior Data Engineer
On-site · Vaughan, Ontario, Canada
Job Summary
Senior Data Engineer responsible for designing, developing, and maintaining scalable real-time and batch data pipelines using AWS Glue, Lambda, Apache Spark, and Kafka to power operational efficiency and financial forecasting. Own end-to-end AI/ML workflows including feature engineering, model training infrastructure, and real-time inference, and evolve data lake architecture for efficient storage and retrieval at scale. Collaborate with Finance, Operations, and Product to translate data requirements into scalable solutions, and use Infrastructure as Code (Terraform/CloudFormation) to provision infrastructure. Maintain data quality through statistical modelling and continuously explore AI/ML technologies to enhance processing capabilities in a fast-paced, startup-like environment. Knowledge of Delta Lake, AWS services, and data engineering best practices is required; visa sponsorship is not provided for this role. Current location is Vaughan, Ontario, Canada with in-person work expectations.
Required Qualifications
- Experience designing and maintaining real-time data streaming pipelines
- Experience building robust data lake infrastructure and architecture
- Ownership of full data lifecycle from ingestion to AI-driven insights
- Experience with AWS Glue, Lambda, Apache Spark, and Kafka
- Experience implementing end-to-end AI/ML workflows including feature engineering and real-time inference
- Knowledge of statistical modelling for data quality and forecasting
- Collaboration with Finance, Operations, and Product teams
- Infrastructure as Code experience (Terraform/CloudFormation)
- Experience with Delta Lake for data processing
- Strong focus on scalable, high-availability pipelines
- Ability to work in a startup-like environment and own projects end-to-end
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.