Data Engineer
$61,900–$141,000 year
On-siteO'Fallon, Illinois, United States
Job Summary
Develop and deploy pipelines and platforms that organize disparate data into meaningful formats for clients. Build scalable ETL or ELT workflows to support reporting and analytics while maintaining data stores that supply big data for business analysis. Create software to retrieve, parse, and process structured and unstructured data from IoT, machine learning, and artificial intelligence sources. Work within a multi-disciplinary team to assess, design, and maintain advanced technology solutions for mission-driven projects ranging from fraud detection to national intelligence. Maintain scalable data platforms and support project teams to monitor and operate these systems effectively.
Required Qualifications
- 2+ years of experience utilizing Python
- 2+ years of experience developing and maintaining scalable data stores that supply big data in forms needed for business analysis
- Experience utilizing programming languages, including C++, Java, or Linux
- Experience creating software for retrieving, parsing, and processing structured and unstructured data
- Experience developing scalable ETL or ELT workflows for reporting and analytics
- Ability to develop scripts and programs for converting various types of data into usable formats, and support project team to scale, monitor, and operate data platforms
- Secret clearance
- Bachelor's degree
Desired Qualifications
- Experience in application development utilizing SQL or Scala
- Experience with a public cloud, including AWS, Microsoft Azure, or Google Cloud
- Experience with distributed data or computing tools such as Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka
- Experience working on real-time data and streaming applications
- Experience with NoSQL implementation using MongoDB or Cassandra
- Experience with data warehousing, including AWS Redshift, MySQL, or Snowflake
- Experience with UNIX or Linux, including basic commands and Shell scripting
- Experience with Agile engineering practices
- TS/SCI clearance with a polygraph
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.