Jr. AI Engineer - Data Annotation
$75,000–$90,000 year
HybridNew York City, New York, United States or New York, United States
Job Summary
Conduct hands-on data annotation and quality control by labeling, reviewing, and correcting classification outputs as a core member of the data science pipeline. Identify bottlenecks and repetitive steps within the workflow, then fix them using Python, SQL, and agentic development tools to improve speed and consistency. Build and run quality checks that measure inter-annotator agreement and surface systematic errors before they reach production. Document annotation guidelines to support team scaling while collaborating closely with data scientists and ML engineers to close the loop between labeling and model performance.
Required Qualifications
- Solid programming ability
- hands-on Python experience
- willingness to dig into scripts
- SQL experience
- data wrangling ability
- Comfortable using agentic development tools
- A quality-first mindset
- Dependable
- Adaptable
- Energized by messy, real-world data
- Energized by working alongside other data-minded people
- Hungry, self-directed
- ready to grow
- 3+ days in-office in New York City
Desired Qualifications
- Familiarity with feedback loops in ML systems
- how label quality connects to model performance
- Experience with annotation platforms (Label Studio, Prodigy, Scale, or custom-built systems)
- Familiarity with active learning or online learning approaches
- Experience with SQL and building lightweight dashboards to track quality metrics
- Background in NLP or text classification workflows
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.