Big Data Engineer
On-site · Creve Coeur, Missouri, United States
Job Summary
As a Big Data Engineer, you will develop innovative software using state of the art big data streaming architectures. You will need extensive experience with distributed platforms like HBASE, Hadoop/Spark, and AWS EMR, as well as strong ETL skills. Proficiency in general-purpose programming languages such as Java, C, Scala, Python, and Erlang is essential, alongside database technology skills in Postgres, Mongo, Cassandra, and SQL. Familiarity with data lakes and container management practices such as Docker and Kubernetes is considered a plus.
Required Qualifications
- Extensive experience setting up and doing development for a distributed platform, such as HBASE, Hadoop/Spark, AWS EMR, Cassandra
- Extensive ETL experience
- General Purpose Programming languages (Java, C, Scala, Python, Erlang, etc.)
- Database Technology - (Postgres, Mongo, Cassandra, Elastic Search, Oracle, etc.) as well as SQL and related query languages
Desired Qualifications
- Experience with cloud big data technology (AWS Data Pipeline, GCP DataFlow, Azure HDInsight)
- Experience with Business Intelligence Platforms
- Experience with modern JavaScript
- API Development (proper microservice separation, HTTP verb usage)
- Docker/Kubernetes/Cloud Foundry experience
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.