Data Engineer - senior
On-siteBrno, South Moravian, Czechia
Job Summary
Architect hybrid data pipelines bridging on-premise SQL Server estates and Google Cloud Platform environments. Implement Change Data Capture and streaming updates to synchronize cloud data, while designing BigQuery architectures optimized for partitioning and clustering. Orchestrate complex, multi-stage workflows using Cloud Composer, Dataform, SSRS, and Databricks to monitor production systems. Troubleshoot pipeline failures and maintain data integrity across Star and Snowflake schemas by collaborating with analysts and business leads. This senior role focuses on solving complex plumbing problems to enable the Analytics and AI teams within Product & Technology, which supports over 7,500 global end users.
Required Qualifications
- Experience in data engineering or warehousing, specifically owning the full lifecycle of a data pipeline
- Mastery of T-SQL (stored procedures, CTEs, tuning)
- Experience moving data via SSIS or similar tools
- Hands-on experience with GCP, particularly BigQuery and Cloud Storage (GCS)
- Strong skills in Python for scripting, API interactions, and data manipulation (Pandas or PySpark)
- Deep understanding of dimensional modelling and designing scalable schemas
- Familiarity with tools like Cloud Dataflow, Dataproc, or Cloud Composer
Desired Qualifications
- Experience using Terraform to provision cloud resources
- Familiarity with CI/CD pipelines (GitHub Actions/Jenkins) and Git version control
- Experience using Pub/Sub for messaging and streaming ingestion
- Knowledge or experience of implementing a Mesh and Data Products
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.