Senior Forward Deployed Data Engineer, Data Modernizaton
$180,000–$180,000 year
RemoteUnited States
Job Summary
Lead platform-specific builds that migrate health system legacy data into modern, AI-ready lakehouses, serving as the technical lead under the Principal Solutions Architect. You will partner directly with customer data and IT teams on-site, designing ingestion pipelines from EHR systems like Epic Clarity and Caboodle, and configuring governance and data-sharing patterns for Delta Sharing or Snowflake Reader Accounts. Own the end-to-end architecture for greenfield or acceleration engagements, ensuring all environments are governed, documented, and reproducible before handoff to the integration team. Sustain production environments between engagements while developing reusable accelerators and cross-training on Databricks, Snowflake, or Microsoft Fabric to maintain team flexibility.
Required Qualifications
- 8+ years in data engineering or data platform roles, at a Senior or Staff IC level
- Client-facing maturity — comfortable working on-site in a customer's environment and presenting technical work to their data and IT leadership
- Deep, hands-on expertise in at least one of Databricks, Snowflake, or Microsoft Fabric
- Has shipped production data workloads in a regulated environment (HIPAA, HITRUST, or comparable)
- Strong in Python and distributed data processing (PySpark or equivalent), plus SQL and modern transformation tooling
- Comfortable as the sole platform expert on an engagement — you can own a build, not just contribute to one
- Infrastructure-as-code fluency (Terraform) and CI/CD discipline (GitHub Actions)
- Databricks: Delta Lake, Unity Catalog, Delta Sharing, Delta Live Tables, Photon
- Snowflake: Snowpark, Reader Accounts, Streams & Tasks, Dynamic Tables, Snowpipe, strong dbt fluency
- Microsoft Fabric: OneLake, SQL Server Mirroring for CDC, Fabric Data Factory, Fabric External Sharing, Iceberg shortcuts
Desired Qualifications
- Bonus: production Databricks experience inside a health system or Databricks partner consultancy
- Bonus: Epic Clarity inside Snowflake
- Bonus: prior Azure Synapse / ADF / Databricks-on-Azure background
- Resident / customer-success solutions architect or engineer from a cloud data platform vendor (Databricks, Snowflake, Microsoft FastTrack / CSU)
- Senior data engineer from a health system running on your platform, or from a platform-partner consultancy
- Familiarity with EHR data models and the realities of on-prem-to-cloud CDC
- Background in consulting, professional services, or data platform implementation in regulated industries (healthcare strongly preferred; fintech a strong adjacent)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.