Senior Data Engineer
$145,000–$160,000 year
HybridBoston, Massachusetts, United States
Job Summary
Design and lead data pipelines that ingest and process real-time grid data, architecting seamless integration into LineVision's data platform. Own system of record architecture and implement next-generation data infrastructure supporting company growth. Lead cross-functional collaboration with Infrastructure, Data Science, Product, and Business teams to define data needs and architect solutions. Establish relationships with key stakeholders, complete onboarding on existing pipelines and AWS infrastructure, and take ownership of critical data pipelines to identify gaps and propose architectural improvements. This role involves designing monitoring and alerting systems, optimizing relational database systems for query performance, and leading database migrations into a unified environment. You will own schema management and cataloging solutions to enable discoverability and lineage tracking.
Required Qualifications
- Advanced proficiency in Python
- Advanced proficiency in SQL
- Track record designing and optimizing production data pipelines
- Deep experience with AWS storage services
- Deep experience with AWS compute services
- Experience making architecture-level trade-off decisions
- Strong background in data modeling
- Experience with ETL design
- Experience with job orchestration frameworks such as Apache Airflow
- Experience leading small to medium-scale projects
- Outstanding collaboration skills
- Proven ability to lead technical discussions across diverse audiences
Desired Qualifications
- Experience working with large volumes of real-time time-series data in production environments
- Experience mentoring or informally leading other engineers on pipeline design and best practices
- Familiarity with analytical tools such as Tableau or Power BI
- Demonstrated ability to independently execute complex migrations with attention to data integrity and reliability
- Hands-on experience with sensor data pipelines using lambda functions
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.