AWS– Spark –Python Data Engineer
On-siteVirginia, United States
Virginia, United StatesOn-siteFull TimeSenior LevelBachelors DegreeSmall
Full TimeSenior LevelBachelors DegreeSmall
Job Summary
Build data pipelines using Apache Spark in AWS, leveraging Glue, EMR, Lambda, Step Functions, and S3 to process events within Kafka and event-driven architectures. Develop cloud-native applications and data platforms while adhering to Agile methodologies and continuous integration/deployment practices. Apply deep Python and PySpark expertise to solve business problems through innovation across the software development lifecycle. Join a collaborative environment focused on experimentation, improvement, and learning for customers globally. AWS Architect certifications are a plus.
Required Qualifications
- Strong hands on experience building data pipelines using Apache Spark in AWS
- Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM
- Proficient in python programming language
- Proficient in PySpark
- Knowledge of application development lifecycles, & continuous integration/deployment practices
- Experience with development on AWS and cloud native applications
- Experience with Developing Data Platforms on AWS
- Proficient in Agile Software Development methodology, processes, and practices
- Bachelor's degree in related field
- Strong, analytical, focused, self-driven with excellent problem-solving skills
- Minimum 2+ years of hands on in-depth experience of AWS Data Pipelines development and implementation
Desired Qualifications
- Kafka and event driven architectures exposure is a plus
- AWS Architect Associate or Professional level certifications is a plus
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.