Data Engineer
On-siteCarmel, Indiana, United States
Job Summary
Identify, troubleshoot, and resolve data and processing errors in existing solutions while developing, maintaining, and updating data sets to standardize collection practices. Extract, integrate, and move data to and from third-party providers, executing technical plans for ETL processes, warehouse updates, and performance tuning. Create documentation of data warehouse structures and flows, collaborate on technical designs, and participate in architecture meetings to define project scope and timelines. Mentor other ETL Developers and Junior Data Engineers, assist in gap analysis for Business Intelligence initiatives, and contribute to discussions on data management strategy evolution.
Required Qualifications
- Bachelor's degree or equivalent combination of education and experience
- 3-5 years of experience in data engineering, ETL development, or a related role
- Extensive hands-on experience with Informatica and AWS Glue for data integration and transformation
- Strong proficiency in Python for data engineering and automation
- Deep expertise in AWS Lambda and other cloud-based data services
- Strong understanding of data warehousing concepts, data modeling, and SQL
- Experience with big data technologies and distributed computing frameworks
- Experience with cloud data platforms such as AWS Redshift, Snowflake, or BigQuery
- Advanced knowledge of data governance, security, and compliance best practices
- Proficiency in workflow orchestration tools (e.g., Apache Airflow, Step Functions)
- Familiarity with DevOps practices and CI/CD pipelines for data engineering
- Experience with real-time data processing frameworks such as Kafka or Kinesis
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.