Sr Data Engineer
Hybrid · Johns Creek, Georgia, United States
Job Summary
Senior Data Engineer at BeyondTrust responsible for building scalable ETL pipelines and data infrastructure to support analytics on the SaaS platform. Work involves leveraging AWS services (Lambda, DynamoDB, Neptune), extensive Datadog and CloudWatch monitoring, applying data governance practices, performing data modelling, and designing efficient data pipelines to populate a data lake. Requires mastery of AWS data services, Spark, SQL, Python, Snowflake, Hadoop ecosystem, Hive/Presto, and YARN, with a fixed Johns Creek, GA location and potential telecommuting from a home office (hybrid arrangement).
Required Qualifications
- Master's degree in Information Systems or related field
- Four (4) years of experience in a Data Engineering role
- Experience with Petabyte-sized Data Lakes
- Deep AWS experience building end-to-end data applications
- Spark experience (RDDs, DataFrames, low-level optimizations)
- Spark optimization tools (Ganglia, Log4J, Spark UI)
- Data warehousing
- Data modeling
- SQL development
- Python
- Three (3) years of experience with Snowflake
- AWS Athena serverless data warehousing
- One (1) year of experience with Hadoop ecosystem
- Hive and Presto
- YARN resource management
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.