Staff Implementations Data Engineer
On-siteLondon, England, United Kingdom
Job Summary
Develop, deploy, and continuously improve distributed, big-data pipelines powering Altana's state-of-the-art network analysis, machine learning, data ingestion, and fusion capabilities. Understand and drive forward the technology to enhance scalability while meeting evolving customer requirements. Support platform reliability, cost controls, and customer security reviews and accreditations. Serve as the technical expert in client-facing meetings, bridging complex government requirements with platform architecture. Evaluate and recommend new tools, technologies, and best practices for data pipeline development, orchestration, and deployment. Work within a cross-functional team of engineers, data scientists, and product managers. Obtain UK Security Check (SC) clearance or maintain active clearance.
Required Qualifications
- 8+ years of technical experience in data engineering or closely related roles
- extensive experience across the design, development, and maintenance of complex data models from a variety of sources and schemas
- Demonstrated track record of leading the full lifecycle (Design, Development, Test, Deploy, Monitor, Maintain) of data ingestion and standardization pipelines at scale
- Experience deploying and integrating software solutions across client cloud environments (AWS/GCP/Azure), managing core services like EC2, S3, IAM, and Dockerized microservices
- Experience leading and mentoring other engineers on complex data engineering projects
- You are eligible and willing to obtain UK Security Check (SC) clearance or have an active clearance already
- Excellent written and verbal communication skills, with a track record of successfully interacting directly with external customers and stakeholders to scope technical work and manage expectations
- Keep up to date with latest trends in data engineering and care deeply about engineering excellence and knowledge sharing
- Python
- Spark
- SQL
- AWS
- Azure
- Git
- Rest APIs
- Kubernetes
- Docker
- Terraform
- Datadog
- Databricks
- OpenSearch
- Postgres
Desired Qualifications
- Experience with managing a data platform, including monitoring and managing releases, costs and infrastructure changes
- Expertise or experience with the deployment of ML pipelines
- Exposure to trade compliance, supply chain management or a field similarly related to international commerce
- Experience working with or within the public sector
- Familiarity using AI tools to enhance the quality & pace of your output
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.