Data Platform Engineer
Hybrid · McDonough, Georgia, United States
Job Summary
Data Platform Engineer responsible for building, optimizing, and governing a Databricks-based data platform hosted on AWS, connecting disparate data sources to enable reliable data pipelines for business intelligence, analytics, and ML initiatives. Key focus areas include defining and enforcing data strategy and governance, administering Databricks environments on AWS, designing scalable ETL/ELT pipelines with Delta Lake and Delta Live Tables, integrating AWS services (Glue, Kinesis, EventBridge, Lambda) with Databricks, ensuring pipeline reliability with monitoring and automated recovery, and collaborating with data analysts and scientists to deliver fit-for-purpose datasets. Requires 5+ years in data engineering, strong Databricks and AWS expertise, Python and SQL proficiency, and a Bachelor's degree or equivalent practical experience.
Required Qualifications
- 5+ years of hands-on data engineering experience in a cloud environment.
- Strong proficiency with Databricks (Notebooks, Workflows, Delta Lake, Unity Catalog, SQL Warehouses).
- Deep expertise with AWS services: S3, IAM, VPC, Glue, Redshift, RDS, Lambda, Kinesis, or EventBridge.
- Proficiency in Python for data engineering workloads; SQL expertise required.
- Experience designing and building data lake / lakehouse architectures.
- Familiarity with data transformation tooling such as dbt, Apache Spark, or similar frameworks.
- Knowledge of data modeling concepts (dimensional modeling, data vault, or medallion architecture).
- Experience with infrastructure-as-code tools such as Terraform is a strong plus.
- Databricks Certified Associate or Professional certification preferred.
- AWS Certified Data Analytics or Solutions Architect certification preferred.
- Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent practical experience.
- Proven track record of delivering end-to-end data platform solutions at scale.
Desired Qualifications
- Databricks Certified Associate or Professional certification (preferred)
- AWS Certified Data Analytics or AWS Solutions Architect certification (preferred)
- Terraform experience (strong plus)
- Databricks certification (preferred)
- Experience delivering end-to-end data platform solutions at scale (preferred)
- Experience with Delta Lake, Unity Catalog, Delta Live Tables (preferred)
- Experience with CI/CD for data workflows (preferred)
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.