Data Engineer, Senior
$77,500–$176,000 year
On-siteHuntsville, Alabama, United States
Job Summary
Deploy and develop pipelines and platforms that organize disparate data into meaningful insights for clients handling mission-driven projects ranging from fraud detection to national intelligence. Manage the assessment, design, building, and maintenance of scalable data systems while guiding a multi-disciplinary team of analysts, engineers, and developers in an agile environment. Perform analytical exploration and data examination to help clients find answers within structured and unstructured datasets. Work with a multi-disciplinary team to implement advanced technology solutions using scalable ETL or ELT workflows, cloud storage optimization, and distributed computing tools.
Required Qualifications
- 5+ years of experience designing data warehouse or data lake, RESTful API models, event processing, or business intelligence for software systems
- 5+ years of experience building scalable ETL or ELT data pipelines, automating large-scale batch and streaming data workflows, and parsing structured, unstructured, or event-streaming data
- 5+ years of experience with coding in software programming languages, including SQL, Python, Scala, Spark, or Java
- Experience performing tuning on data lake architecture to optimize cloud storage and pipeline performance
- Experience with data management solutions that address aspects of data catalog, data usage, governance policies, and lifecycle management
- Secret clearance
- Bachelor's degree and 6+ years of experience designing, developing, operationalizing, and maintaining data systems
- 10+ years of experience designing, developing, operationalizing, and maintaining data systems in lieu of a degree
- Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information
- TS/SCI clearance with a polygraph
Desired Qualifications
- 3+ years of experience architecting and designing large-scale enterprise data and analytics systems
- 3+ years of experience using and developing data systems with AWS and Microsoft Azure cloud data products such as AWS EMR, AWS Glue, Azure Dataverse, Azure Data Factory, and Power Apps
- Experience with distributed data or computing tools, including Apache Spark, Apache NiFi, AirFlow, Databricks, Snowflake, Redshift, or BigQuery
- Experience with federal information system policies, including NIST 800.53 and FISMA, data security, access controls, and data protection techniques
- Experience creating and improving continuous automation across multiple technical stacks, and automating CD/CD pipelines with tools such as Jenkins or GitHub
- Experience with NoSQL database such as Elasticsearch, Solr, MongoDB, or Cosmo DB
- Experience with AI or ML pipelines and processes
- Master's degree
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.