Lead Software Engineer - Data/ Python/ AWS
On-site · Jersey City, New Jersey, United States
Job Summary
Lead Software Engineer responsible for delivering secure, production-grade Python-based data solutions on AWS, architecting data pipelines with Iceberg, Databricks, AWS Glue, and DuckDB, and driving scalable cloud infrastructure. The role includes building robust data infrastructure, automating deployments with CloudFormation and Terraform, guiding architectural evaluations with external vendors and internal teams, and fostering a diverse, inclusive team culture. Key duties include developing high-quality production code, reviewing and debugging code, enabling operational stability, and contributing to communities of practice focused on new technologies in a fast-paced, agile environment.
Required Qualifications
- 5+ years hands-on experience in Python and/or Data engineering
- Formal training or certification on Software Engineering concepts
- Experience delivering system design, application development, testing, and operational stability
- Strong proficiency in Python with hands-on experience with AWS services (ECS, EKS, Lambda, S3, IAM, RDS, Fargate, Glue, etc.)
- Experience with data lake technologies (Apache Iceberg, Databricks, AWS Glue, DuckDB)
- Experience with monitoring/alerting tools (CloudWatch, X-Ray, Prometheus, Grafana, Splunk)
- Knowledge of agile methodologies (CI/CD, Application Resiliency, Security)
- In-depth knowledge of financial services IT systems
- Practical cloud-native experience
- Preferred: AWS Certifications (Solutions Architect, Developer, Data Analytics)
- Experience with NLP, AI/ML workflow orchestration, or advanced analytics pipelines
- Prior experience building enterprise-scale data platforms or analytics solutions
- Experience with Docker/Kubernetes and cloud-native patterns
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.