Lead Data Products Engineer
RemoteLondon, England, United Kingdom
Job Summary
Lead the Data Products team by engaging with subject matter experts to define, design, and evolve data products within the internal Data and Processing Platform that support modelling processes and client-facing outputs. Build a deep understanding of the data domain by capturing key sources, tracking their flow into modelling, and ensuring outputs meet real demands for analytics. Drive the design and development of foundational data products, collaborating with the Platform team to establish data capture and transformation processes. Own specific domain products and their supporting processes, taking responsibility for ongoing quality, adoption, reliability, and evolution. Formalise data contracts by owning schemas, versioning strategies, data governance workflows, and backwards compatible interfaces. Provide technical leadership alongside the Product Owner to shape design decisions and balance commercial delivery with long-term strategy. Drive engineering best practices to ensure quality, reliability, and observability are built in from inception. Take an active role in agile development from refinement through delivery, driving iterative improvement of products and team processes.
Required Qualifications
- practical experience as a senior or lead engineer in high-performing teams focused on the design and curation of data products
- strong experience working with Python for both Data and Application engineering
- expert knowledge of data management technologies (SQL, NoSQL, Databricks etc.)
- familiarity working with modern software engineering tools (Git, CI/CD pipelines), cloud technologies (e.g. AWS, Azure) and Data Lakehouse Architectures
- experience of designing and implementing technical data governance strategies with a focus on data quality and discoverable metadata
- practical knowledge of data-mesh or data-product-oriented architectures
- experience working with agile methodologies (e.g. Scrum/Kanban), with an understanding of the key principles that underpin their effective use
Desired Qualifications
- You are passionate about data and its real-world application, with a drive to gain a deep understanding of the domain and modelling data products to genuinely serve the people who depend on them
- You will have practical experience as a senior or lead engineer in high-performing teams focused on the design and curation of data products, collaborating closely with domain experts and fellow engineers, and taking pride in what you create
- You are strong at solving complex problems and can flexibly consider different technologies/engineering approaches to achieve this
- You have strong experience working with Python for both Data and Application engineering and understand both domain modelling and application programming
- You have expert knowledge of data management technologies (SQL, NoSQL, Databricks etc.)
- You have familiarity working with modern software engineering tools (Git, CI/CD pipelines), cloud technologies (e.g. AWS, Azure) and Data Lakehouse Architectures
- You have experience of designing and implementing technical data governance strategies with a focus on data quality and discoverable metadata, with practical knowledge of data-mesh or data-product-oriented architectures
- You are passionate about communicating complex concepts succinctly to both technical and non-technical audiences to reach a common understanding
- You have experience working with agile methodologies (e.g. Scrum/Kanban), with an understanding of the key principles that underpin their effective use
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.