Birlasoft—AI Test Engineer -Testing Services

Job description

Description: Area(s) of responsibility .Job Title: Senior AI Test Engineer Experience: 4–5 Years Location: Hybrid / Onsite Employment Type: Full-time Key Responsibilities - Define and implement end-to-end test strategies for AI-enabled applications. - Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows. - Perform functional, integration, regression, system, and UAT testing. - Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks. - Develop and maintain API automation frameworks. - Validate AI model responses for: - Accuracy - Relevance - Consistency - Hallucinations - Bias - Toxicity - Test prompt engineering scenarios and optimize prompt quality. - Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy. - Verify AI guardrails, content moderation, and responsible AI compliance. - Perform database validation using SQL. - Conduct performance and load testing for APIs and AI services. - Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers