Data Engineer
On-site · London, England, United Kingdom
Job Summary
Design, build, and maintain robust real-time market data pipelines from multiple cryptocurrency exchanges and data vendors, ensuring high availability, low latency, and data integrity across feeds; manage historical data storage, ingestion, normalisation, and cataloguing of tick data, order book snapshots, trade data, and derived market signals for quantitative research and back-testing; collaborate with researchers and trading engineers to deliver clean, well-documented datasets that accelerate alpha discovery and strategy development; build data-serving layers (time-series DBs, data APIs, query engines) for large-scale historical queries and real-time access; monitor pipeline health, implement observability, and respond to data quality issues or latency that could impact live trading; evaluate and adopt modern data engineering technologies (streaming frameworks, columnar formats, distributed query engines, cloud-native platforms) to improve throughput and reliability; document data schemas, pipeline architectures, and runbooks for maintainability across the team.
Required Qualifications
- Bachelor’s, Master’s, or Ph.D. degree in Computer Science, Engineering, Mathematics, or a related quantitative or technical field
- Minimum of 3 years of professional experience in data engineering, with production-grade data pipelines
- Proficiency in Python and/or a JVM-based language (Java/Scala) for pipeline development, with solid SQL skills
- Hands-on experience with real-time streaming technologies such as Kafka, Redpanda, or similar
- Experience with time-series or columnar databases (TimescaleDB, InfluxDB, Arctic, ClickHouse, kdb+, Parquet-based data lakes)
- Familiarity with cloud infrastructure (AWS, GCP, or Azure) and IaC; experience with Docker/Kubernetes is a plus
- Experience in financial services, quantitative trading, or data-intensive tech; crypto exposure a plus
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.