Test Lead (Azure- Databricks)
On-siteToronto, Ontario, Canada
Job Summary
Develop a comprehensive test strategy for the Azure Databricks ecosystem and design automated data test frameworks, engineering pipelines, and scripts. Coordinate and lead User Acceptance Testing, Business, and End-to-End testing activities while identifying performance bottlenecks and supporting security testing. Create and maintain quality engineering documentation, log detailed product defects, and support root cause analysis. Track testing progress, provide metrics on QE effort, and communicate with development teams and stakeholders across the matrix organization. Mentor the testing team, coach on best practices, and serve as the single point of contact for all data testing activities. This role requires 10+ years in data platform quality engineering within Canadian banking, with expertise in Python, PySpark, and Azure services.
Required Qualifications
- At least 10+ years of work experience in Quality Engineering (Testing) in Data platforms
- Canadian Banking domain experience
- Experience in leading and testing large scale, complex Data Modernization initiatives
- Led Data Platform migration projects such as from Cognos to PowerBI, etc.
- Automation first mindset
- Experience working in a matrix organization
- Stakeholder management across multiple areas such as Business, Infrastructure, Network, IT Custodians, Development, etc.
- In-depth knowledge in testing Azure Databricks, Azure ADLS Gen2, Azure Data Factory, Azure PowerBI, SQL Server
- Excellent coding skills in Python, PySpark, Scala, SQL, Java
- Excellent analytical and problem-solving skills, communication skills
- Knowledge in Data testing, ETL testing, implementation of Automation test frameworks in Data platforms
- Knowledge in Data governance, Data pipeline framework, Data ingestion, Data ops, Data profiling, Unity catalog, etc.
- Proactive in identifying gaps and raising issues
- Self-motivated, possessing initiative to get things done with high quality
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.