Data Engineer
On-siteCharlotte, North Carolina, United States
Charlotte, North Carolina, United StatesOn-siteFull TimeMasters Degree
Full TimeMasters Degree
Job Summary
Develop Spark/ BQ data pipelines in GCP DataProc Cluster and migrate workloads from Hadoop OnPrem cluster to GCP. Build data models and schema to support business requirements while ensuring data quality through automated checks. Optimize performance and adhere to SLAs, documenting and sharing learnings with the geographically distributed team in Charlotte, NC and Bangalore, India. Communicate day-to-day progress concisely to keep the team apprised. This role supports the migration of on-prem infrastructure to the cloud within a distributed engineering environment.
Required Qualifications
- GCP/ Big query Experience - 1 year minimum
- Scala/ Python - 3+ years
- SQL - 3+ years
- Strong SQL, one or more programming language Scala/ Python
- Candidate should be able to communicate in a concise and clear manner to keep the team appraised of day-to-day progress
Desired Qualifications
- Exposure to building semantic layer in LookML
- GCP Certification
- Master's Degree In related field
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.