Asset&Wealth Management-Senior Cloud Data Engineer-Vice President-Dallas
On-siteDallas, Texas, United States
Job Summary
Execute legacy ETL and microservices migrations to AWS, refactoring monolithic code into containerized services deployed on Amazon ECS. Develop end-to-end data flows using AWS Glue, EMR, and Snowflake while implementing Lakehouse patterns with Apache Iceberg. Build production-grade infrastructure-as-code modules in Terraform or AWS CDK and leverage AI coding assistants to automate boilerplate and streamline validation. Lead rigorous peer code reviews, enforce security standards, and configure observability tools for deep visibility into migrated workloads. Optimize Spark configurations and ECS auto-scaling policies to ensure performance. Mentor junior engineers and communicate complex technical concepts to non-technical stakeholders within the wealth management business.
Required Qualifications
- 8+ years of hands-on experience in Data Engineering and Cloud Infrastructure
- Deep technical expertise in Amazon ECS (Fargate/EC2)
- Proven experience with modern data platforms such as Snowflake (AI Data Cloud) and cloud-native services
- Good understanding of open-source table formats, specifically Apache Iceberg
- Expert-level proficiency in Java, Python and SQL
- Hands-on experience with Spark, Kafka, and orchestration tools like Apache Airflow, Dagster, or dbt
- Deep understanding of data warehousing and modern data lakehouse architecture
- Bachelor's or Master's degree in computer science, Engineering, Mathematics, or a related field
Desired Qualifications
- Experience with Amazon ECS Service Connect and AWS Cloud Map
- Experience with AWS Glue (PySpark) and Amazon EMR
- Experience with Terraform or AWS CDK
- Experience with GitHub Actions or GitLab CI
- Experience with Apache Iceberg
- Experience with AI coding assistants (e.g., GitHub Copilot)
- Experience building custom automation tools in Python or Go
- Proven track record of upskilling junior engineers
- Ability to explain complex technical concepts to non-technical stakeholders in the wealth management business
- A 'builder' mindset with the ability to navigate ambiguity in a fast-paced environment
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.