Senior Data Platform Engineer
$205,000–$215,000 year
On-siteAnnapolis Junction, Maryland, United States
Job Summary
Create and maintain data workflows and automation pipelines using Apache Airflow to build reliable, scalable, and observable orchestration solutions. Collaborate with data engineers, platform teams, and stakeholders to ensure workflows are efficient, secure, and production ready. Develop Bash scripts to automate manual processes and utilize Python and Java for recent software development. Implement complex workflow orchestration, scheduling, and monitoring using Apache Airflow, while leveraging distributed big data processing engines like Apache Spark. Manage containerization with Docker, containerd, and Podman, and maintain Git source control. Requires 5 years of software engineering experience and active TS/SCI clearance with polygraph. Telework 16 hours weekly.
Required Qualifications
- Active TS/SCI w/Polygraph
- 5 years of experience as a software engineer
- Bachelor's degree in a technical discipline
- 2 additional years of experience as a software engineer may be substituted for a degree
- Experience using the Linux CLI and Linux tools
- Experience developing Bash scripts to automate manual processes
- Recent software development experience using Python and Java
- Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
- Experience using Distributed Big Data processing engines including Apache Spark
- Experience with containerization technologies such as Docker, containerd, and Podman
- Experience with Git Source Control System
- 16 hours/week Telework
Desired Qualifications
- Experience using the Atlassian Tool Suite (JIRA, Confluence)
- Familiar with AWS Cloud Services and Infrastructure
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.