Sr. Software Engineer - Big Data, Data Lake
$120,000–$150,000 year
Remote · United States
Job Summary
Sr. Software Engineer (Big Data, Data Lake) at a remote-first company building a data-driven automotive software platform. Lead and implement scalable data ingestion, transformation, and integration across multiple sources using AWS-native services to power APIs, microservices, and downstream analytics. Design robust data lake and transformation layers, drive data availability, reliability, and performance, and collaborate with cross-functional teams. Key competencies include: AWS data services (S3, Glue, Athena, Lake Formation, Step Functions, Lambda, Kinesis, API Gateway), building high-volume data pipelines, data cleansing and quality, entity resolution, back-end development (Python, SQL) and TypeScript/Node.js, event-driven architectures (SNS/SQS, EventBridge), cloud data warehouses (Athena, Snowflake, Redshift, BigQuery), security practices for data storage and access, and experience in multi-tenant data architectures. 7-10 years software experience, 5+ years AWS cloud-native, and strong leadership and communication skills are required.
Required Qualifications
- 7-10 years of professional software development experience
- 5+ years in an AWS cloud-native environment
- Strong hands-on experience with AWS data services: S3, Glue, Athena, Lake Formation, Step Functions, Lambda, Kinesis Data Stream, API Gateway
- Experience designing and optimizing data pipelines for high-volume, multi-source ingestion
- Experience with entity resolution, data cleansing, data quality, and anomaly detection
- Expert-level back-end development with Python, SQL, and Step Functions; experience with Lambda
- Strong TypeScript and Node.js for backend services (REST/JSON APIs)
- Experience with cloud data warehouses (Athena, Snowflake, Redshift, BigQuery)
- Experience building event-driven systems (SNS/SQS, EventBridge); orchestration frameworks (Step Functions)
- Experience integrating AWS data pipelines with external platforms (Snowflake, Metabase, BI tools)
- Security best practices for data storage, transfer, and API access
- Excellent communication and cross-functional collaboration
- Experience with on-call rotations to address incidents
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.