Senior Solutions Architect – Healthcare Data Migration
On-siteMesa, Arizona, United States
Job Summary
Lead complex customer engagements from discovery to delivery, architecting and executing the decommissioning of legacy Teradata environments into scalable Databricks Lakehouses. Design automated cloud infrastructure using Terraform and apply expert Spark internals knowledge to troubleshoot, tune, and optimize large-scale distributed workloads. Implement strict HIPAA and PHI compliance models with Unity Catalog for fine-grained access control while championing best practices in PySpark and Delta Lake. Proactively build Proof of Concepts and architecture workshops to demonstrate solution vision, mentoring engineering teams on enterprise data migration strategies. Requires 15+ years of experience in enterprise architecture and cloud modernization within the healthcare domain.
Required Qualifications
- 15+ years of dedicated experience in data engineering, enterprise architecture, and major cloud migrations
- Deep, hands-on history migrating legacy Teradata estates, BTEQ scripts, and enterprise warehouses
- 4+ years of hands-on expertise including job optimization, debugging, and workload governance
- Deep understanding of Spark Internals, PySpark, Databricks SQL (DBSQL) performance tuning, and Delta Lake
- Proven experience using Terraform to provision and manage cloud infrastructure in highly regulated environments
- Solid understanding of patient data complexities, data models, and strict compliance (HIPAA/PHI) guardrails
- Proven ability to identify and solve complex technical problems with minimal oversight
Desired Qualifications
- Databricks Certified Data Engineer Professional or Databricks Certified Solutions Architect
- Full-scale enterprise implementation experience with Delta Live Tables (DLT) and Unity Catalog (UC)
- Experience in large-scale data migration or production technical consulting for enterprise clients
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.