Backend Engineer (Data pipeline)
On-siteSunnyvale, California, United States
Job Summary
Develop low latency services and lead end-to-end service implementations, including data feeds ingestion and orchestration. Accelerate the migration of legacy on-prem Hive/Spark/Airflow pipelines to public cloud using GCP, BigQuery, and DataProc to improve SLAs and data quality. Lead the discovery phase of medium to large projects, designing high-level architecture and managing small engineering teams of three to four members. Troubleshoot business and production issues while driving execution of multiple business plans and establishing innovation strategies. This six to twelve-month contract supports a direct client in Sunnyvale CA, focusing on cost efficiencies and accelerated execution for their data infrastructure modernization efforts.
Required Qualifications
- Develops innovation strategies, processes, and best practices
- Drives the execution of multiple business plans and projects
- Supports and ensures business objectives being met
- Leads the discovery phase of medium to large projects to come up with high level design
- Leads the work of other small group of 3 to 4 engineers for assigned Engineering projects
- Leads and participates in end to end service implementations, data feeds ingestion, and orchestration
- Designs and implements low latency services
- Promotes and supports company policies, procedures, mission, values, and standards of ethics and integrity
- Troubleshoots business and production issues
- Accelerate migration of legacy on-prem Hive/Spark/Airflow pipelines and workloads to public cloud
- leveraging GCP
- BigQuery
- DataProc
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.