Senior Engineer, Data Management
$140,000–$150,000 year
On-siteNew York City, New York, United States or New York, United States
Job Summary
Design and build scalable, secure pipelines that ingest, transform, and move large volumes of structured and unstructured data across systems. Build APIs and complex database logic to automate data fetch, transformation, and storage, while leveraging generative AI tools to accelerate development on Snowflake, Microsoft Fabric, and Databricks. Architect modular components deployed via containerized workflows and maintain data solutions across AWS, Azure, and Google Cloud. Implement data quality, security, and governance standards for PHI, PII, and PCI data, partnering with analysts and scientists to power downstream reporting. Provide technical leadership by mentoring engineers and reviewing designs, applying DevSecOps and Agile methodologies to plan and deliver work.
Required Qualifications
- 7+ years building production data pipelines
- strong Python (or equivalent)
- both relational and non-relational database experience
- Hands-on experience with generative AI tools applied to data engineering workflows
- Experience designing and maintaining data solutions on at least one major cloud platform (AWS, Azure, or GCP)
- Experience with ETL tools, data modeling, and building reusable, modular components for complex systems
- Working knowledge of containerization (Docker/Kubernetes) or similar deployment practices
- Experience implementing data governance, security, and quality standards, ideally including regulated data (PHI/PII/PCI)
- Experience with Informatica IDMC/MDM or comparable data integration and master-data tooling
- Solid grounding in data structures, algorithms, and software architecture, with experience documenting and testing complex systems
- Comfort working directly with data analysts, data scientists, and business stakeholders to translate requirements into pipelines and products
- Experience with Agile delivery (Jira, Scrum, or Kanban) and DevSecOps practices
- Bachelor's degree in computer science, Information Systems, or a related field
- 7+ years of experience as a Data Engineer, including senior or lead-level project ownership
Desired Qualifications
- Master's preferred
- Prior experience leading a small team of data engineers/analysts
- Experience with data classification and taxonomy tools, particularly within Informatica
- Exposure to BI/reporting tools (e.g., Power BI, Tableau, Looker) to support downstream analytics consumers
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.