Data Engineer
On-siteChampaign, Illinois, United States
Job Summary
Design, develop, and optimize scalable data pipelines integrating internal and external sources while building robust platforms supporting advanced analytics and predictive modeling. Develop, test, and enhance data products to meet evolving client needs, ensuring high data quality, integrity, and availability through continuous monitoring. Collaborate with engineers, data scientists, and stakeholders to improve data accessibility, implementing best practices like automated testing, version control, and Infrastructure as Code. Continuously evaluate new tools to improve platform performance and reliability, delivering innovative, data-driven solutions that create measurable business value.
Required Qualifications
- 3–6 years of experience as a Data Engineer or in a related data engineering role
- Bachelor's degree in Computer Science, Engineering, Mathematics, or another quantitative discipline
- Strong experience designing and building scalable, data-intensive applications and pipelines
- Proficiency in Python and SQL, with experience developing efficient, maintainable code for large datasets
- Experience with distributed data processing technologies such as Apache Spark and/or Databricks
- Experience working with cloud platforms including AWS, Microsoft Azure, or Google Cloud Platform (GCP)
- Experience with workflow orchestration tools such as Apache Airflow
- Knowledge of Git, CI/CD pipelines, automated testing, and Infrastructure as Code
- Strong analytical and troubleshooting skills with a focus on improving data reliability and quality
- Excellent communication and collaboration skills with the ability to work effectively across cross-functional teams
- Self-motivated, detail-oriented, and committed to continuous learning
Desired Qualifications
- Experience in financial services, consulting, or risk management is a plus
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.