Senior Data Engineer — Enterprise Data Platform
On-siteChandigarh, Chandigarh, India
Job Summary
Design and maintain enterprise data pipelines and storage layers using medallion architecture, operating as the enterprise tenant within a multi-tenant platform. Develop pull-based ingestion flows with Azure Data Factory and custom Python connectors to land data from diverse source systems. Build transformation pipelines focused on data quality, lineage, and observability while implementing security features like PII masking and tenant isolation. Collaborate with product teams to drive self-service adoption and establish monitoring, alerting, and cost tracking integrations. Contribute to infrastructure as code and CI/CD practices for platform deployment. This role supports the Technology Architecture team in Basware IT, directly impacting analytics, platform development, and business decisions across the enterprise.
Required Qualifications
- 5+ years of experience building scalable, maintainable, and self-service data solutions
- Strong background in batch and streaming pipeline design, orchestration, and schema management
- Hands-on experience with Databricks (Unity Catalog, Delta Lake), Apache Spark, and Python/SQL
- Experience with Azure cloud services, particularly Azure Data Factory, Azure Data Lake Storage (ADLS), and related data integration tooling
- Deep understanding of data quality validation and monitoring frameworks
- Familiarity with medallion architecture patterns and layered data processing
- Excellent collaboration skills across engineering, product, and enterprise stakeholder teams
- Proven ability to write clean, maintainable, and well-structured code
- Strong problem-solving mindset
- Demonstrated experience with AI-assisted coding: spec-driven development, systematic validation of AI-generated output (functional and technical), and a controlled-adopter approach — AI amplifies productivity, the human owns every line that ships.
Desired Qualifications
- Experience with infrastructure as code (Terraform or similar) and CI/CD pipelines (e.g. GitHub Actions, Azure DevOps)
- Familiarity with multi-tenant data architectures, catalog-level isolation, and enterprise data governance
- Experience building or integrating pull-based ingestion patterns from APIs, ERPs, or other enterprise systems
- Exposure to Databricks Asset Bundles (DABs) or similar deployment frameworks
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.