Data Engineer II
$119,900–$162,200 year
On-siteSeattle, Washington, United States
Job Summary
Design, develop, and support complex data pipelines from diverse sources for Redfin's data platform. Work with Engineering and Analytics teams to create and maintain data exchange systems using structured and unstructured data. Collaborate with end users to gather requirements and ensure 100% accuracy by fully testing and verifying all code before production. Identify process improvements by automating manual tasks and optimizing for performance and coding best practices. Support and maintain dev, test, and prod environments as part of a weekly on-call rotation.
Required Qualifications
- 3+ years experience with a modern programming language (Python, Java, etc)
- 3+ years experience with complex SQL, data modeling and database technologies (Postgres, MySQL, Snowflake, etc)
- Experience creating and maintaining complex data pipelines
- Experience with batch and streaming data pipelines
- Experience with both structured and unstructured data sets
- Ability to translate business needs into technical requirements
- Ability to structure data to make it accessible, performant, and resilient to change
- Ability to handle ambiguity and function in a fast paced, constantly changing environment
- Ability to communicate well with both technical and non technical users
Desired Qualifications
- Python is preferred
- Snowflake is preferred
- Experience with Git / Jenkins / Airflow / Docker / Kubernetes / Spark is a plus
- Experience with API development is a plus
- Experience with cloud services (AWS / Azure / GCP) is a plus
- AWS is preferred
- Experience with message queuing and stream processing data is a plus
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.