Human AI Evaluation Specialist at Virtusa
India
<span id="requisitionDescriptionInterface.reqTitleLinkAction.row1" title="">Human AI Evaluation Specialist</span><span> </span><span id="requisitionDescriptionInterface.ID1455.row1" title="">-</span><span> </span><span id="requisitionDescriptionInterface.ID1465.row1" title="">(</span><span id="requisitionDescriptionInterface.reqContestNumberValue.row1" title="">CREQ245208</span><span id="requisitionDescriptionInterface.ID1479.row1" title="">)</span><h2 xmlns:ftl="http://www.taleo.net/ftl" xmlns:htm="http://www.w3.org/1999/xhtml" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><span>Description</span></h2><span><span> </span></span><span id="requisitionDescriptionInterface.ID1529.row1" title=""><p><strong>Human AI Evaluation Specialist</strong></p><p><strong>Role Focus:</strong> Human-in-the-loop Validation · Model Output Quality</p><p><strong>Role Summary</strong></p><p>Human AI Evaluation Specialists will perform structured human evaluation of Gemini AI outputs by labeling, rating, and providing qualitative feedback on model relevance, correctness, safety, and enterprise usability.</p><p><strong>Key Responsibilities</strong></p><p>Perform manual evaluation of AI-generated responses</p><p>Label datasets for training and validation</p><p>Apply quality rubrics and evaluation guidelines</p><p>Identify hallucinations, bias, and factual errors</p><p>Provide structured feedback for model improvements</p><p>Support benchmark creation and golden dataset validation</p><p><strong>Required Skills & Experience</strong></p><p>2+ years in content review, data labeling, QA, or AI evaluation</p><p>Strong analytical and critical thinking skills</p><p>Excellent written communication skills</p><p>Familiarity with AI evaluation frameworks is preferred</p><p>High attention to detail</p></span><span><span> </span></span><span><span> </span></span><span><span> </span></span><h2 xmlns:ftl="http://www.taleo.net/ftl" xmlns:htm="http://www.w3.org/1999/xhtml" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><span id="requisitionDescriptionInterface.ID1576.row1" title="">Primary Location</span></h2><span id="requisitionDescriptionInterface.ID1593.row1" title="">:</span><span> </span><span id="requisitionDescriptionInterface.ID1603.row1" title="">IN-AP-Hyderabad</span><h2 xmlns:ftl="http://www.taleo.net/ftl" xmlns:htm="http://www.w3.org/1999/xhtml" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><span id="requisitionDescriptionInterface.ID1788.row1" title="">Schedule</span></h2><span id="requisitionDescriptionInterface.ID1805.row1" title="">:</span><span> </span><span id="requisitionDescriptionInterface.ID1815.row1" title="">Full Time</span><h2 xmlns:ftl="http://www.taleo.net/ftl" xmlns:htm="http://www.w3.org/1999/xhtml" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><span id="requisitionDescriptionInterface.ID1838.row1" title="">Employee Status</span></h2><span id="requisitionDescriptionInterface.ID1855.row1" title="">:</span><span> </span><span id="requisitionDescriptionInterface.ID1865.row1" title="">Individual Contributor</span><h2 xmlns:ftl="http://www.taleo.net/ftl" xmlns:htm="http://www.w3.org/1999/xhtml" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><span id="requisitionDescriptionInterface.ID1888.row1" title="">Job Type</span></h2><span id="requisitionDescriptionInterface.ID1905.row1" title="">:</span><span> </span><span id="requisitionDescriptionInterface.ID1915.row1" title="">Experienced</span><h2 xmlns:ftl="http://www.taleo.net/ftl" xmlns:htm="http://www.w3.org/1999/xhtml" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><span id="requisitionDescriptionInterface.ID1938.row1" title="">Travel</span></h2><span id="requisitionDescriptionInterface.ID1955.row1" title="">:</span><span> </span><span id="requisitionDescriptionInterface.ID1965.row1" title="">No</span><h2 xmlns:ftl="http://www.taleo.net/ftl" xmlns:htm="http://www.w3.org/1999/xhtml" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><span id="requisitionDescriptionInterface.ID1988.row1" title="">Job Posting</span></h2><span id="requisitionDescriptionInterface.ID2005.row1" title="">:</span><span> </span><span id="requisitionDescriptionInterface.reqPostingDate.row1" title="">11/02/2026, 9:09:08 AM</span>
Apply Now