QA Engineer

QA Engineer based in Latin America to support a long-term project for a software development client in Atlanta, GA. Responsibilities include contributing to the AI evaluation framework for LLM outputs across multiple environments, defining and implementing test assertions, maintaining regression baselines, developing automated test suites (end-to-end, integration, regression) for backend APIs, document ingestion pipelines, AI inference, and frontend surfaces; contributing to performance/load testing for latency-sensitive paths; ensuring CI/CD quality gates; participating in production incident triage; producing test artifacts/audit logs supporting SOC 2 Type II compliance; and collaborating with Forward Deployed Engineering for client-side validation and reproducing real-world scenarios. Requirements include advanced English, 5+ years in QA engineering with at least 1 year in AI/ML testing, experience with LLM evaluation, proficiency in Python/TypeScript, and experience with CI/CD pipelines. Bonus points for a CS/SYS degree, fintech/banking experience, and familiarity with observability tools like Arize or Langfuse. What we offer: long-term positions, USD compensation, PTO, and collaboration with skilled engineers.