Senior Software Engineer, Data Engineering
$179,400–$224,300 year
RemoteCalifornia, United States or Colorado, United States
Job Summary
Design, build, and optimize scalable ETL pipelines and data architectures to ensure high throughput and low latency for Omada's data processing platform. Create and maintain logical and physical data models for business intelligence while implementing robust data quality checks and governance frameworks. Integrate diverse data sources including APIs, databases, and third-party platforms into a unified system, monitoring production environments to meet defined SLAs. Collaborate with data scientists, analysts, and product management on technical vision, design, and planning to deliver solutions that support strategic decision-making. Lead documentation efforts and establish department-wide procedures to resolve complex problems and improve platform scalability.
Required Qualifications
- 5+ years of experience building, maintaining, and orchestrating scalable data pipelines
- 3+ years of experience as a data engineer developing or maintaining integration with software such as Airflow or any Python-based data pipeline codebase
- Experience applying a variety of integration patterns for different use cases
- Experience in backend software development to contribute to distributed computing development and data technologies, with broad experience across systems, contexts, and ideas
- Experience implementing data pipelines and improving the performance of ETL processes and related SQL queries
- Experience in data modeling for OLTP and OLAP applications
- Experience with Cloud platforms such as Amazon AWS
- Exceptional Problem solving and analytical skills
- Experience working with sensitive data i.e. PHI / PII & security best practices
- Familiarity with data governance practices and principles
- Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL)
- Proficiency in Analytical SQL (e.g. Analytics Queries, Distributed database queries) and experience working with massive parallel processing (MPP) databases (e.g., Redshift, BigQuery, Snowflake)
- Proficiency in programming languages such as Python, Java, or Scala
- Knowledge of data modeling techniques (3NF) and tools (e.g., ER/Studio, ERwin)
- Software Engineering Mindset: Apply best practices to write elegant, maintainable code and understand automated testing concepts
- Familiarity with business intelligence tools and environments
- Familiarity with big data technologies (e.g., Lambda, Iceberg or Delta Lake, Spark, or Kafka)
- Software engineering mindset and an ability to write elegant, maintainable code while following engineering best practices
- Excellent communication and collaboration skills, both written and verbal, with the ability to convey complex technical concepts to non-technical stakeholders
- Self-Directed: Leading projects and tasks effectively with cross functional stakeholders minimal guidance. You care about writing quality software and recognize that there are often many right answers. Ability to lead tasks and projects effectively
- Bachelor's degree in Computer Science or a similar discipline
Desired Qualifications
- Familiarity with workflow management tools (Airflow preferred)
- Familiarity with cloud-based data warehouses (Amazon Redshift preferred)
- Experience with NoSQL databases (e.g., document and graph databases)
- Experience building internal frameworks or development productivity tools
- Experience building data infrastructure, frameworks and automation
- Experience using Generative AI tools or technologies to improve engineering workflows, automation, analytics, or data platform capabilities
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.