Senior AI QA Test Engineer

About the job

Job Title : Senior AI QA Test Engineer – Agentic GenAI We are seeking a Senior AI - QA Test Engineer with extensive experience in AI / ML Quality Engineering, specializing in Agentic GenAI systems, evaluation frameworks, observability, and reliability testing. You will ensure the quality and consistent performance of our enterprise-scale AI ecosystem across Snowflake, AWS, and Azure. Responsibilities • Design and implement QA strategies for LLM, RAG, and Agentic AI pipelines. • Develop automated test suites for agentic workflows, LLM applications, APIs, and vector-search systems. • Validate retrieval workflows, reasoning behavior, grounding quality, and reduce hallucination tendencies. • Build evaluation pipelines with robust metrics and regression frameworks (covering grounding, hallucination risks, and retrieval evaluation). • Implement AI observability: telemetry, drift monitoring, quality dashboards. • Integrate automated testing into CI/CD workflows. • Establish enterprise QA best practices for AI governance and reliability. Required Qualifications • 5+ years of experience in QA / Quality Engineering. • 2+ years testing AI systems including LLM apps, RAG pipelines, and agentic workflows. • Python proficiency for automation, test harnesses, and evaluation development. • Experience testing data / AI pipelines in Snowflake and at least one major cloud (AWS / Azure). • Experience with distributed systems, API testing, and CI / CD. • Strong communication and collaboration skills.

Requirements

• QA Engineering
• AI Systems Testing
• Python
• AWS
• Azure

Qualifications

• 5+ years of experience in QA / Quality Engineering

Preferred Technologies

• QA Engineering
• AI Systems Testing
• Python
• AWS
• Azure

About the company

Insight Global specializes in providing talent solutions to various industries, offering skilled professionals who thrive in challenging environments. We focus on quality engineering and ensure that our teams have a robust understanding of the technology landscape, particularly within AI and ML sectors.