Job Description
Design and execute manual and automated test cases for backend APIs, frontend interfaces, and end-to-end AI workflows. Conduct exploratory testing of new generative AI features and user interactions. Develop and maintain automated test frameworks for UI and API. Build automation scripts for AI/ML pipelines using pytest, unittest, or custom frameworks. Create comprehensive test plans , manage defects, and report results using Jira, or similar tools. Validate RAG (Retrieval-Augmented Generation) pipelines, including embedding accuracy, retrieval quality, and model response evaluation. Test AI agents and orchestration flows , ensuring correctness in multi-step reasoning and tool invocations. Perform performance and scalability testing for ML inference endpoints (SageMaker, Bedrock, custom APIs), monitoring latency and throughput. Conduct inte...