Big Data
RemoteUnited States
Job Summary
Design and develop "Transformations" aspects using the ELT framework to modernize ingestion pipelines and build data transformations at scale. Provide technical expertise in designing and implementing ratings data ingestion pipelines with AWS cloud technologies, S3, Hive, Databricks, Scala, Python, and Spark. Build and maintain a data environment ensuring speed, accuracy, consistency, and uptime while enforcing data governance principles, quality checks, and lineage across every hop. Monitor industry trends to evaluate emerging big data and cloud technologies, ensuring compliance through enterprise standards and best practices. Lead issue resolution and provide technical direction to teams, articulating requirements into solutions within Agile frameworks.
Required Qualifications
- Position to handle issue resolution and provide direction to teams both technically and functionally
- Ability to articulate and convert requirements into solutions
- Expert knowledge of Agile approaches to software development
- Ability to put key Agile principles into practice to deliver solutions incrementally
- Excellent analytical thinking
- Interpersonal, oral, and written communication skills
- Strong ability to influence both IT and business partners
- Ability to prioritize and manage work to critical project timelines
Desired Qualifications
- Experience With Machine Learning Libraries and Frameworks (TensorFlow, MLlib)
- Experience with development frameworks as well as data and integration technologies such as Informatica, Python, Scala
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.