Data Engineering Lead
On-siteWashington, United States
Washington, United StatesOn-sitePart TimeSenior LevelSmall
Part TimeSenior LevelSmall
Job Summary
Collaborate with data scientists and software engineers to develop data-driven solutions for transportation systems. Architect and build scalable data pipelines and ETL processes while optimizing database structures for performance. Ensure data quality through validation techniques and establish governance policies to achieve regulatory compliance. Work with cloud infrastructure to scale pipelines efficiently and mentor junior engineers to foster continuous learning. Drive innovation in data modeling and leverage distributed systems to tackle engineering challenges.
Required Qualifications
- Bachelor's in Computer Science, Data Science, or a related field
- 7+ years of experience in data engineering, preferably in a startup or fast-paced environment, with prior leadership roles
- Strong proficiency in SQL (for DDL operations, DML operations, data architecture, etc.)
- Strong proficiency in Python and Jupyter (for exploratory data analysis, writing scripts, aggregating datasets, working with data scientists/GIS developers, etc.)
- Knowledge of data modeling, data warehousing, and ETL processes
- Experience with cloud-based data platforms such as Snowflake and AWS
- Experience working with DBMSs such as PostgreSQL and MySQL
- Familiarity with extracting, analyzing, and mapping geospatial data and GIS systems
- Familiarity with distributed systems and big data technologies such as Apache Spark
- Understanding of data visualization concepts and tools
- Strong problem-solving and analytical skills
- Excellent communication and collaboration skills
- Ability to work independently and adapt to changing priorities
- Passion for learning and keeping up with the latest trends in data engineering and technology
Desired Qualifications
- Leadership experience preferred
- experience working with large datasets in a Python/SQL environment
- hands-on knowledge of the latest data programming approaches, data structures, distributed DBMS and DB modeling and access languages
- ability to architect and build pipelines
- thrives in a startup environment
- enjoys working in a fast-paced and agile setting
- make a significant impact and help shape the direction of our data engineering initiatives
- exhibit excellent knowledge of data engineering disciplines
- self-starter
- not afraid to take ownership of projects
- handle the challenges that come with a rapidly evolving startup
- resourceful, innovative, and continuously seek opportunities to improve processes and drive efficiency
- strong communication and collaboration skills enable you to work effectively with cross-functional teams and stakeholders
- passionate about data engineering and are eager to contribute to the success of a startup
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.