Sr. Data Engineer
On-siteHouston, Texas, United States
Job Summary
Build analytics tools leveraging data pipelines to drive insights on customer acquisition and operational efficiency. Create and maintain optimal data pipeline architectures while assembling large, complex datasets using SQL, Python, and Scala on Azure. Work with stakeholders across Executive, Product, and Design teams to resolve technical issues and support infrastructure needs. Identify and implement internal process improvements by automating manual tasks and redesigning systems for greater scalability. Manage data extraction, transformation, and loading from diverse sources while ensuring security and adherence to Agile methodologies.
Required Qualifications
- Minimum 10+ years of experience
- Analytics/data product solution architecture on Azure (Azure Data Factory, Databricks)
- Data extract, load and transformation techniques and tools including orchestration of needed azure resources
- Azure analytics services
- Programming, scripting (Python, SQL, Scala)
- Analytics data frameworks (Spark etc.)
- Data architecture concepts understanding (relational and dimensional data models)
- Information security
- Software engineering tools and methodologies (e.g. Agile, ADO, Ansible, GIT)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.