Consort Group logo
Consort GroupPosted 1 month ago

Data Engineer Senior H/F

HybridParis, Île-de-France, France

Full TimeSenior Level

Job Summary

Conduct feasibility studies for Cloudera CDP, Google Cloud Platform, and Lake House migrations, then design and execute Spark and SQL transformations for Big Data workloads. Prepare data through cleaning, transformation, encryption, and loading before migration, while developing unit, integration, and performance tests. Deploy applications to production, manage failovers, and monitor treatments via log and Spark metric analysis to diagnose incidents. Ensure post-migration support and collaborate with architecture, platform, and Data squads to continuously improve industrialization practices.

Required Qualifications

  • 7 ans d'expérience en Data Engineering dans des environnements Big Data et Cloud
  • Spark
  • SQL et traitements batch distribués
  • Cloudera CDP
  • Parquet, Apache Iceberg
  • Google Cloud Platform (GCS, Dataproc ou GKE)
  • Kubernetes (exécution de jobs Spark)
  • Git, GitLab CI/CD, Docker
  • Lecture de logs, monitoring et diagnostic des traitements
  • Méthodologie Agile
  • Jira, Confluence, GitHub Copilot
  • Sens du service
  • Esprit d'analyse et de synthèse
  • Excellent relationnel et communication
  • Esprit collaboratif
  • Organisation et adaptabilité
  • Autonomie
  • Curiosité
  • Capacité à travailler avec des équipes techniques et métiers
  • Contrat : Freelance
  • Lieu : Villejuif
  • Télétravail : [Hybride selon mission]

Desired Qualifications

  • notions appréciées

Hiring someone like this?

Get your role in front of qualified candidates on Sorce.

Get started

Apply to this job in one click with Sorce

Apply on Sorce