Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI)
$229,900–$262,400 year
On-site · McLean, Virginia, United States
Job Summary
As a Senior Lead Data Engineer at Capital One, you'll collaborate across Agile teams to design, develop, and implement technical solutions using data movement tools and technologies. Responsibilities include optimizing information systems, utilizing programming languages like Python and SQL, and sharing expertise on emerging technologies. You'll lead a team of developers with experience in distributed computing and full stack systems, while engaging in unit testing and code reviews to ensure high-quality deliverables. Requirements include a Bachelor’s Degree, significant experience in application development, big data technologies, and cloud computing.
Required Qualifications
- Bachelor’s Degree
- At least 6 years of experience in application development (Internship experience does not apply)
- At least 2 years of experience in big data technologies
- At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Desired Qualifications
- Master's Degree
- Experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot) to accelerate the software delivery
- 9+ years of experience in application development including Python, SQL, Spark, ETL tools, AWS Glue
- 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- 5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL)
- 4+ year experience working on real-time data and streaming applications
- 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
- 4+ years of data warehousing experience (Redshift or Snowflake)
- 4+ years of experience with UNIX/Linux including basic commands and shell scripting
- 4+ years experience with data modeling for data warehousing
- 2+ years of experience with Agile engineering practices
Additional Requirements
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.