Java Spark Developer
$2,500,000–$2,500,000 year
RemoteUnited States
United StatesRemoteContract$2,500,000–$2,500,000 yearSmall
ContractSmall
Job Summary
Design and operate complex data platforms and data engineering solutions on AWS, leveraging Spark, EMR, Hadoop, Hive, and DynamoDB for real-time ingestion and processing. Architect and develop distributed systems for large-scale data extraction, utilizing Java, Scala, Python, and SQL to build microservices with Spring Boot. Implement AWS Glue, Lambda functions, and Kinesis pipelines while managing NoSQL databases like MongoDB and DocumentDB. Requires 8+ years in data platforms, 6+ years in AWS architecture, and 2-3 years with Spark. Remote position.
Required Qualifications
- Advanced Java proficient
- Microservices
- Spring boot
- Writing SQL Queries (proficient)
- AWS
- 4-5 Yrs in Java
- 2-3 exp - Spark
- Minimum of 8 years of experience in building complex Data Platforms and Data Engineering solutions
- Minimum of 6 years of hands on experience in architecture and development of data solutions in AWS environment using AWS Services
- Experience with big data technologies such as: Spark, EMR, Hadoop, Hive
- Experience programming with at least one modern language such as Scala, Java, Python
- Hands on experience on NoSQL DBs like DynamoDB, DocumentDB, MongoDB
- Hands on experience on implementing AWS Glue, EMR, Lambda functions, SQS, SNS
- Experience on Real-time data ingestion and processing in AWS especially using services like AWS Kinesis
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience with data m
Desired Qualifications
- Good to have
- Unix Shell scripting
- AWS certification is preferred
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.