Virtusa

AI QA Lead - (CREQ223802)

Description

The candidate should collaborate with business stakeholders to identify and define use cases. Design develop and execute automated tests using Python to ensure the functionality and performance of the product. Conduct manual testing where necessary to complement automated tests. Write complex SQL queries for test data generation and validation

Test and validate the product developed by the developers ensuring it meets the specified requirements

Stay informed and proficient in GenAI evaluation frameworks applying them effectively to assess the product

Perform rigorous testing of machine learning ML and deep learning DL components. Knowledge of Synthetic data generation techniques. Demonstrate in depth knowledge of evaluation based frameworks such as RAGAS Retrieval Augmented Generation for Automated Systems and a basic understanding of how RAG Retrieval Augmented Generation works. Define and implement testing strategies. Exhibit excellent communication and documentation skills to clearly report issues document test cases and articulate the results to technical and non technical stakeholders.

Apply analytical skills to troubleshoot and resolve complex problems ensuring the highest quality standards are met.

Primary Location

: LK-1-Colombo

Schedule

: Full Time

Employee Status

: Individual Contributor

Job Type

: Experienced

Travel

: No

Job Posting

: 18/06/2025, 12:51:19 PM