Databricks Consultant - Onsite NYC
On-siteNew York City, New York, United States or New York, United States
Job Summary
Design and implement data pipelines using Databricks to process and transform large-scale datasets, optimizing clusters for performance, reliability, and cost efficiency. Collaborate with client technical teams to gather requirements, create customized data solutions, and implement ETL processes ensuring data quality, security, and accuracy. Provide guidance on best practices for leveraging Databricks for analytics and data engineering while troubleshooting issues in data workflows and platform configurations. Stay updated with the latest Databricks features to recommend innovative solutions. This role involves 3-6 contract hours from 9 AM - 5 PM EST for a grow-stage tech strategy firm focused on deep client relationships and long-term problem solving.
Required Qualifications
- Bachelor's degree in computer science, Data Engineering, or a related field
- 3+ years of experience in data engineering and pipeline development
- Expertise in Databricks, Spark, and PySpark
- Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud
- Proficiency in programming languages such as Python or Scala
- Strong knowledge of ETL processes, data integration, and data warehousing concepts
- Exceptional problem-solving and analytical skills
- Strong communication skills to effectively collaborate with cross-functional teams
Desired Qualifications
- Databricks certifications (e.g., Databricks Certified Data Engineer Associate or Professional)
- Experience with data visualization tools such as Tableau or Power BI
- Familiarity with data governance frameworks and security best practices
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.