Azure/AWS Architect/Delivery Lead-Banking - Senior Manager
On-siteBengaluru, Karnataka, India
Job Summary
Lead the design and implementation of scalable data architectures using Azure and AWS platforms, overseeing data engineering projects to enhance integration and transformation processes. Manage the development and optimization of data pipelines and workflows using Apache Airflow and DAGs, while guiding teams in deploying data warehouses like Snowflake and Azure Data Factory. Coordinate with stakeholders to align data strategies with business objectives, implementing security best practices and performance tuning for MySQL and PostgreSQL systems. Coach and mentor team members to foster continuous learning in data engineering practices, collaborating with cross-functional teams to deliver data-driven insights that support strategic decision-making.
Required Qualifications
- At least a Bachelor's degree
- At least 14 years of experience
- Oral and written proficiency in English
- Proficient with Azure cloud computing, including big data technologies
- Deep understanding in both traditional and modern data architecture and processing concepts including relational databases (e.g., SQL Server, MySQL, PostgreSQL), Data warehousing, big data, NoSQL and business analytics
- Rich experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis services
- Experience in building stream-processing systems, using solutions such as Storm or Spark-Streaming
- Understanding of big data use-cases and Lambda/Kappa design patterns
- Knowledge of real time/stream analytics trends
- Architecture, design, implementation, and/or support of complex application architectures (i.e. having an architectural sense for connecting data sources, data visualization, structured and unstructured data, etc.)
- Demonstrable hands-on experience implementing Big Data solutions using Microsoft Data Platform and Azure Data Services
- Azure SQL DB, Azure Synapse Analytics, Azure HD Insight, Azure Data Lake Storage, Azure Data Lake Analytics, Azure Machine Learning, Stream Analytics, Azure Data Factory, Azure CosmosDB and Power BI
- Exposure to Open-Source technologies such as Apache Spark, Hadoop, NoSQL, Kafka, Solr/Elastic Search
- Well versed with quality processes and implementation
- Excellent communication skills
- Business / domain knowledge in TMT Domain
- Good knowledge of Application DevOps tools (Git, CI/CD Frameworks)
- Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit
- Good understanding of Data Modeling and Data Architecture
- Data Engineering on Microsoft Azure (DP 200/201/203)
- Azure Solutions Architect Expert (AZ 303/304)
Desired Qualifications
- Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
- Leveraging advanced skills in Azure and AWS cloud platforms
- Demonstrating proficiency in data engineering and data architecture
- Utilizing Apache Hadoop and Apache Airflow for data processing
- Developing data strategies and data transformation processes
- Excelling in database management and optimization techniques
- Leading teams in data modernization and product innovation initiatives
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.