Full Stack Data Engineer
On-siteLisbon, Lisbon, Portugal
Job Summary
Develop end-to-end features on an AWS cloud-based big data platform focused on data analysis and processing. Create proofs of concept and produce production-ready versions, then perform testing, deploy to development and production environments, monitor initial performance, and carry out debugging and ongoing maintenance. Actively contribute to discussions on feature architecture, define required data flows and processes, and document developed features using Confluence. Support data extraction and exploratory data analysis activities. This role supports a dynamic, young team committed to growth, offering training in the latest technologies, health and life insurance, and social events.
Required Qualifications
- Experience with Python, particularly in data manipulation and processing
- Experience with SQL
- Experience in programming and debugging
- Interest in data science
- Experience with AWS cloud services, such as S3, Lambda, Athena, EC2, Glue, AWS CDK/CloudFormation, Step Functions, Batch, and Fargate
- Experience with Spark/PySpark
- Experience with Git
- Experience with Jupyter Notebooks
- Experience developing applications and/or working in production environments
- Proactivity and initiative
- Strong teamwork skills
- Ability and motivation to independently find solutions to problems
- Interest in learning new skills
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.