Databricks Data Engineer - Bengaluru
On-siteBengaluru, Karnataka, India
Bengaluru, Karnataka, IndiaOn-siteFull TimeLarge
Full TimeLarge
Job Summary
Build and operate end-to-end data pipelines on the Lakehouse covering ingestion, transformation, and serving across AWS and Databricks. Design interactive dashboards in Tableau/Superset for mixed audiences and write scalable SQL and Python using Spark, Starburst, and Trino. Model data in open table formats like Iceberg and Delta Lake while orchestrating workflows with Airflow and GitHub Actions CI/CD. Apply governance practices using Unity Catalog and partner with stakeholders to translate business questions into robust data solutions. Contribute to AI/GenAI efforts by preparing data foundations for RAG and agentic use cases.
Required Qualifications
- 2–5 years in Data Engineering & Analytics
- Strong proficiency in SQL and Python
- Databricks depth: Unity CatLog, Delta Live Tables / declarative pipelines, Workflows, notebooks
- Hands-on Apache Spark for pipeline development
- Experience with large datasets via Starburst/Trino/AWS Athena
- Exposure to the AWS data stack (S3, Glue, Athena, EMR)
- Apache Airflow
- Familiarity with Apache Iceberg or other table formats (Delta Lake, Hudi)
- CI/CD experience with GitHub Actions
- Dashboarding experience in Tableau/Superset/PowerBI
- Strong communication skills and the ability to translate business questions into data solutions
- Must have Skills : - 2–5 years in Data Engineering & Analytics
- Strong proficiency in SQL and Python
- Databricks depth: Unity CatLog, Delta Live Tables / declarative pipelines, Workflows, notebooks
- Hands-on Apache Spark for pipeline development
- Experience with large datasets via Starburst/Trino/AWS Athena
- Exposure to the AWS data stack (S3, Glue, Athena, EMR)
- Apache Airflow
- Familiarity with Apache Iceberg or other table formats (Delta Lake, Hudi)
- CI/CD experience with GitHub Actions
- Dashboarding experience in Tableau/Superset/PowerBI
- Strong communication skills and the ability to translate business questions into data solutions
Desired Qualifications
- GenAI/LLM awareness — RAG patterns, embeddings/vector stores, and familiarity with agentic frameworks and MCP-based tooling; interest in building the data layer that powers AI agents
- Fluency with AI-assisted development (e.g., coding copilots / Claude Code) to accelerate delivery
- Comfort with Agile and DevOps ways of working
- Nice to have : - GenAI/LLM awareness — RAG patterns, embeddings/vector stores, and familiarity with agentic frameworks and MCP-based tooling; interest in building the data layer that powers AI agents
- Fluency with AI-assisted development (e.g., coding copilots / Claude Code) to accelerate delivery
- Comfort with Agile and DevOps ways of working
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.