Sr. GCP Data Engineer (Job-ID 3301)
RemoteUnited States
Job Summary
Design, develop, and maintain scalable batch and real-time data pipelines on GCP using BigQuery, PySpark, and Dataflow. Implement and manage Medallion Architecture layers, orchestrate workflows with Cloud Composer, and optimize complex SQL queries for analytical workloads. Build high-performance data transformations, manage storage lifecycle via GCS, and enforce security governance through IAM. Ensure solutions meet performance, scalability, reliability, and cost-efficiency standards. This remote role supports KANINI's enterprise-grade data solutions with a focus on robust architecture and modern CI/CD practices.
Required Qualifications
- Google Cloud Platform (GCP)
- BigQuery (partitioning, clustering, query optimization)
- Medallion Data Architecture
- Python and PySpark
- Java
- SQL (complex joins, window functions, performance tuning)
- Cloud Dataflow
- Cloud Composer (Airflow)
- Google Cloud Storage (GCS)
- version control systems (Git) and CI/CD practices
- GCP IAM and cloud security best practices
Desired Qualifications
- large-scale enterprise data platforms
- data warehousing and data lake concepts
- real-time streaming frameworks
- data governance and data quality frameworks
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.