Senior Data Engineer
On-siteLetterkenny, Ulster, Ireland
Job Summary
Build and optimize data pipelines, logic, and storage systems using Python, R, SQL, Java, Scala, and Pyspark while adhering to Prudential standards. Develop high-quality, well-documented code and conduct complex data analysis to prepare information for predictive modeling. Collaborate with architects, analysts, and scientists to enhance data acquisition, transformation, and reliability, writing unit and integration tests to address quality assurance issues. Manage data ingestion, integration, and transformation across relational and NoSQL databases, including AWS Redshift and Snowflake, while leveraging real-time analytics tools like Spark and Kinesis. This role supports the Global Technology team at Prudential, a global financial services leader with over $1.4 trillion in assets under management, focusing on digital transformation and innovation.
Required Qualifications
- Bachelor of Computer Science or Engineering or experience in related fields
- Experience in working with DevOps automation tools & practices
- Knowledge of full software development life cycle (SDLC)
- Ability to learn new skills and knowledge on an on-going basis through self-initiative and tackling challenges
- Excellent problem solving, communication and collaboration skills
- Applied experience with several of the following: Programming Language: Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting
- Applied experience with several of the following: Data Ingestion, Integration & Transformation
- Applied experience with several of the following: Database Management System
- Applied experience with several of the following: Database tools
- Applied experience with several of the following: Real-Time Analytics
- Applied experience with several of the following: Data Buffering
- Applied experience with several of the following: Workflow Orchesration
- Applied experience with several of the following: Data Visualization
- Applied experience with several of the following: Data Lakes & Warehousing
- Applied experience with several of the following: Data Protection and Security
- Applied experience with several of the following: Common Infrastructure as Code (IaC) Frameworks
- Applied experience with several of the following: Cloud Computing
- Applied experience with several of the following: Testing/Quality
Desired Qualifications
- Serverless data pipeline development using AWS Glue, Lambda and Step functions
- Other Certifications
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.