Data Engineer
$150,000–$200,000 year
On-siteTampa, Florida, United States
Job Summary
Design, develop, and maintain scalable enterprise data pipelines supporting high-volume logistics data and integrate data from multiple enterprise logistics systems into centralized cloud-based repositories. Build and optimize batch and streaming data pipelines using Apache Kafka, Apache Airflow, and Apache NiFi while designing secure, cloud-native storage and compute solutions within AWS or Azure environments. Implement data governance, metadata management, and data quality controls to support predictive analytics, machine learning, and business intelligence dashboards. Monitor, troubleshoot, and optimize cloud infrastructure, create technical documentation, and facilitate knowledge transfer for Government personnel within an Agile software development framework.
Required Qualifications
- Active Top Secret/Sensitive Compartmented Information (TS/SCI) clearance
- Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or a related technical discipline
- Minimum five (5) years of professional Data Engineering experience
- Experience designing and implementing enterprise ETL/ELT data pipelines
- Strong programming experience using Python
- Advanced SQL development experience
- Experience with NoSQL databases
- Experience with Apache Kafka or similar streaming technologies
- Experience with Apache Spark
- Experience with Apache Airflow, Apache NiFi, or comparable orchestration tools
- Experience designing and supporting cloud-based data solutions using AWS or Azure
- Experience implementing enterprise data governance, metadata management, and data quality processes
- Experience integrating data from multiple enterprise applications using APIs
- Strong analytical, troubleshooting, and problem-solving skills
- Excellent written and verbal communication skills
Desired Qualifications
- Experience supporting Department of Defense or Federal Government programs
- Experience supporting logistics, supply chain, sustainment, or operational data environments
- Experience with AWS S3, Azure Blob Storage, AWS KMS, or Azure Key Vault
- Experience developing enterprise data lakes or modern data warehouse solutions
- Experience supporting business intelligence and dashboard development
- Experience with containerized applications and DevSecOps pipelines
- AWS or Microsoft Azure Cloud Certification
- Security+ or other DoD 8570/8140 certification
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.