Senior Data Engineer
Remote
RemotePart TimeSenior LevelMedium
Part TimeSenior LevelMedium
Job Summary
Maintain and enhance 123 SSIS jobs across eight data domains while managing ingestion from S3, Azure Blob, SFTP, and APIs. Investigate and resolve pipeline failures in live production environments, developing transformation logic and implementing data quality checks. Monitor pipeline health, contribute to observability improvements, and support infrastructure migration from IBM Cloud to AWS. Collaborate with the analytics team to ensure platform stability for a major US media client. Some timezone flexibility toward US East Coast hours is appreciated.
Required Qualifications
- Proven experience in ETL pipeline design and maintenance in a production environment
- Hands-on experience with orchestration tools such as SSIS, Prefect, Airflow, dbt, or Azure Data Factory
- Strong SQL and Python skills
- Experience with data ingestion across multiple patterns — cloud storage, SFTP, APIs, and real-world messy/fragile sources
- Solid understanding of data transformation logic and data modelling principles
- Experience with data quality, validation, error handling, and monitoring
- Comfortable working within complex legacy systems and established team workflows
- Good communication skills
- Proactive approach to problem-solving
- Some timezone flexibility toward US East Coast hours
Desired Qualifications
- Familiarity with SSIS or Prefect specifically
- Experience with AWS data services (S3, Glue, etc.)
- Background in media, ad-tech, or content analytics data
- Experience supporting platform migrations (IBM Cloud to AWS or similar)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.