Senior Data Engineer
$153,580–$153,580 year
RemoteUnited States
Job Summary
Lead technical leadership for data ingestion and processing engagements, architecting and implementing cloud-based ETL pipelines while coordinating with onshore and offshore teams. Design and build critical components for complex data projects, working with stakeholders across product, sales, leadership, and marketing functions. Ensure reliability through comprehensive documentation, test cases, and mitigation strategies, while monitoring system health and implementing required governance. Deliver enterprise solutions using a vast range of data engineering and cloud technologies in a fully remote environment. Serve as a critical resource for medium-large teams, driving shared ownership of agendas and goals.
Required Qualifications
- Bachelor's degree or foreign equivalent in Computer Science, Computer Engineering, Information Technology, or a closely related field
- Five (5) years of experience in a Software Development role or related position
- Experience with Big data Tools: Spark, hdfs, Sqoop, hive, Impala, Oozie, Flume, Kafka, Streamset, DMXSynch Sort, Splunk, Python (Numpy, Pandas, matplotlib, scikitlearn), Denodo(data virtualization), RProgramming
- Experience with Cloud Technology: AWS, Azure, Databricks, and Snowflake
- Experience with RDBMS: Teradata, Oracle, DB2, SQL Server
- Experience with Scripting & Automation: Unix Shell Scripting and PL/SQL
- Experience with Job Scheduling tools: CONTROLM, CIS Task Scheduler, IBM Tivoli Workstation
- 100% telecommuting position
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.