Senior Data Engineer
RemoteUnited States
Job Summary
Develop and integrate pipelines to consolidate data from diverse sources, while testing and maintaining the platform to ensure reliability. Facilitate code deployments to stage and production environments and participate in the architecture of end-to-end solutions. Collaborate on feature deliverables and document implemented logic in a structured manner. Assist with data-related technical issues and support infrastructure optimization using Python, Spark, and streaming technologies. This role leverages Azure and AWS cloud services including Data Factory, Databricks, and serverless functions within a remote setting.
Required Qualifications
- Python
- Spark
- Streaming
- Big Data
- graphQL
- devOps
- CICD
- git
- Azure cloud
- Azure Data Factory
- Databricks
- Azure Functions
- Azure DevOps
- AWS cloud
- serverless
- Amazon Neptune
- GCP cloud
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.