Azure Databricks
On-siteBengaluru, Karnataka, India
Bengaluru, Karnataka, IndiaOn-siteFull TimeSenior LevelSmall
Full TimeSenior LevelSmall
Job Summary
Build ETL and data warehouse transformation processes using Azure Data Factory, Apache Spark, and Databricks. Develop complex U-SQL, Spark (Scala or Python), and T-SQL code to create modern data warehouse solutions on Azure Stack. Evaluate tool performance against customer requirements and deliver proof of concept and production implementations within Agile/DevOps sprints. Leverage experience with Hadoop, Hive, Pig, and Impala to optimize big data pipelines. Lead initiatives in Bengaluru or Hyderabad with a 0 to 30-day notice period.
Required Qualifications
- 8 to 13 years Overall IT experience
- Experience in building ETL / data warehouse transformation processes
- Direct experience of building data pipelines using Azure Data Factory and Apache Spark
- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
- Evaluating the performance and applicability of multiple tools against customer requirements
- Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints
- Coding complex U-SQL, Spark (Scala or Python)
- T-SQL
- Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.