Data Engineer
HybridCrystal City, Texas, United States
Job Summary
Design end-to-end solution architectures for secure, cloud-based data platforms supporting federal mission workloads, including ingestion, processing, storage, and analytics layers. Develop reference architectures and design patterns to guide engineering teams, while leading database design and data modeling for relational and analytical workloads. Architect distributed data processing pipelines using Spark and PySpark, defining partitioning and caching strategies to optimize throughput. Define storage and compute optimization strategies to balance performance against budget constraints. Collaborate with DevSecOps to embed security controls into CI/CD workflows and conduct architectural reviews to validate solutions before implementation. Produce documentation and technical briefings for engineering and government stakeholders. Provide technical leadership and mentorship to engineering teams. Hybrid schedule with one on-site day per week; requires Public Trust Level 6C and 3-5 years of Information Assurance experience.
Required Qualifications
- Must Be Able to Obtain Public Trust Level 6C
- 3-5 years of Information Assurance experience
- Python
- Spark
- PySpark
- SQL and Database Implementation
- Data Engineering and Data Pipelines
- Storage and Compute Optimization
- GitHub
- Jenkins/Cloudbees
- Ansible
- Terraform
- Vault
Desired Qualifications
- Bachelor's Degree in Computer Science or related field
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.