Data Engineer - AWS
RemoteUnited States
United StatesRemoteFull TimeBachelors DegreeStartup
Full TimeBachelors DegreeStartup
Job Summary
Design and implement new data pipelines using AWS, Python, and SQL within the Databricks development framework. Build complex scripts to transform ingested data, manage AWS tools and environments, and define ETL strategies for internal and external data sources. Collaborate with business, data science, and visualization teams to ensure data consistency, accuracy, and reliability while supporting the organization's Databricks infrastructure. Partner with stakeholders across divisions to deliver timely, accurate data to thousands of users. Report to the Manager of Data Engineering.
Required Qualifications
- 3+ years of AWS Console, S3, Airflow, EC2, EMR
- 5+ years of data engineering, data pipeline development, and ETL experience using Python, SQL, and databricks
- Experience with using version control tools like GitHub
- Experience with Delta lake, Unity Catalog, Delta Sharing, Delta Live Tables(DLT)
- Proficiency in the Python scripting language, SQL, Cloud databases, and ETL development processes & tools
- Ability to initiate, drive, and manage projects with competing priorities
- Ability to communicate effectively with business leaders, IT leadership, and engineers
- Must have a passion for data and helping the business turn data into information and action
- Bachelors degree in information systems, computer science, or related technical field
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.