Sr. Databricks Platform Engineer

Design and implement Unity Catalog governance, including catalog structure, privilege models, and data lineage, for a multi-tenant platform serving external partners. Architect Delta Sharing provider/recipient models to manage external data onboarding and cross-platform sharing between Databricks and Snowflake. Integrate Microsoft Entra ID with Unity Catalog and establish RBAC across environment tiers. Refactor existing Python pipelines into a production-grade medallion architecture and manage workspace structures, CI/CD, and cost optimization. Contribute to low-level architecture design by challenging and improving existing recommendations rather than solely executing them. This live engagement requires hands-on experience with Unity Catalog and Delta Sharing in production environments, alongside strong Python and PySpark skills.