Data Engineer (all genders)
HybridLisbon, Lisbon, Portugal or Porto, Porto, Portugal
Job Summary
Gather and process raw, structured, semi-structured, and unstructured data using batch and real-time frameworks while monitoring and improving pipeline performance. Design, implement, and manage data pipelines for clients across mobility, automotive, industrial, and financial sectors, supporting stakeholders in making technology decisions. Obtain necessary data transparently to develop intelligent data products in diverse fields. Work on fast-paced projects delivering innovative solutions using Python, Spark, AWS, and streaming technologies. Support customers in developing intelligent data products across various industries.
Required Qualifications
- Python
- Scripting (Bash/Python/Go/Ruby)
- ETL
- Spark
- Amazon Web Services (AWS)
- good communication skills
- CI/CD
- Data Warehouse
- Data Architecture
- English-speaking
- suitable degree
- streaming Processing (Kafka, eventhub etc)
- SQL
- relevant working experience of 5+ years
Desired Qualifications
- Agile Methodologies
- Software Development
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.