Data Engineer
On-siteLos Angeles, California, United States
Los Angeles, California, United StatesOn-siteFull Time
Full Time
Job Summary
Design, construct, and maintain efficient data pipelines to process extensive datasets from Instagram and additional sources. Create systems enabling users to save content to profiles and organize it into collections. Collaborate with machine learning specialists to perfect data gathering for personalization algorithms and evaluate algorithm performance using analytics tools. Uphold strict data privacy and security standards while developing frameworks for user moodboard creation. Liaise with product management and UX/UI teams to align engineering initiatives with user experience objectives.
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related field
- Demonstrated expertise in a Data Engineer or similar role, with an emphasis on social media data integration
- Proficient in Python, Java, Scala, or similar programming languages
- Skilled in using data pipeline and workflow management tools such as Apache Airflow
- Expertise in SQL, relational databases, and familiarity with various database systems
- Experience with big data tools (e.g., Hadoop, Spark) and real-time data processing technologies (e.g., Kafka)
- Familiarity with cloud services like AWS, Azure, or GCP
- Competence in social media platform API integration
Desired Qualifications
- Master's degree
- Knowledge of machine learning algorithms and personalization systems
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.