Remote Opportunity

Human AI Evaluation Specialist

Join Virtusa as a mid professional working remotely from India. Explore the role, benefits, and apply in one place.

Full Time
$80,000 - $120,000*
5 months ago
India
AI Governance & Programs
Mid
AI evaluation frameworks
Data labeling
Quality rubrics
+4 more

Job Description

Human AI Evaluation Specialist - (CREQ245208)

Description

 

Human AI Evaluation Specialist

Role Focus: Human-in-the-loop Validation · Model Output Quality

Role Summary

Human AI Evaluation Specialists will perform structured human evaluation of Gemini AI outputs by labeling, rating, and providing qualitative feedback on model relevance, correctness, safety, and enterprise usability.

Key Responsibilities

Perform manual evaluation of AI-generated responses

Label datasets for training and validation

Apply quality rubrics and evaluation guidelines

Identify hallucinations, bias, and factual errors

Provide structured feedback for model improvements

Support benchmark creation and golden dataset validation

Required Skills & Experience

2+ years in content review, data labeling, QA, or AI evaluation

Strong analytical and critical thinking skills

Excellent written communication skills

Familiarity with AI evaluation frameworks is preferred

High attention to detail

   

Primary Location

: IN-AP-Hyderabad

Schedule

: Full Time

Employee Status

: Individual Contributor

Job Type

: Experienced

Travel

: No

Job Posting

: 11/02/2026, 9:09:08 AM

Requirements

  • 2+ years in content review, data labeling, QA, or AI evaluation
  • Strong analytical and critical thinking skills
  • Excellent written communication skills
  • Familiarity with AI evaluation frameworks
  • High attention to detail
  • Perform manual evaluation of AI-generated responses
  • Label datasets for training and validation

Benefits

  • Health Insurance
  • Dental Insurance
  • Disability Insurance
  • Employee Assistance Program
  • Employee Discounts
  • Flexible Hours
  • Gym Membership

Skills

AI evaluation frameworks
Data labeling
Quality rubrics
Model relevance
Model correctness
Model safety
Model usability

About AI-Estimated Salary

The salary range shown was not provided by the employer. Our AI has estimated it based on the job title, required experience, location, and industry standards (confidence: 80%). This estimate should be used as a general guide only and may not reflect the actual compensation. Always confirm salary details directly with the employer during the application process.

Ready to Apply?

Join Virtusa today

Salary Range (AI-Estimated)*
$80,000 - $120,000
80% confidence
Posted 5 months ago

Explore more remote openings

Browse fresh listings from our global community of remote-friendly teams.

Full Time
$94.8k - $166.2k
5 days ago
United States
Engineering
Senior
Git
Full Time
5 days ago
United States
AI
Senior
Python
AWS
Git
+1 more
Full Time
5 days ago
United States
Data
Mid
Python
API
Full Time
$175.75k - $260k
5 days ago
United States
AI
Executive
AWS
API
Full Time
5 days ago
United States
AI
Mid
API
Full Time
6 days ago
United States
AI
Executive
Git
Full Time
2 weeks ago
Worldwide
AI
Senior
API
Full Time
$145k - $180k
2 weeks ago
United States
AI
Executive
Python
AWS
API
Full Time
$140k - $170k
2 weeks ago
Worldwide
AI
Senior
Python
Git
API
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
2 weeks ago
United States
AI
Executive
Full Time
2 weeks ago
United States
AI
Executive
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
$111.6k - $163.1k
2 weeks ago
United States
AI
Senior
Full Time
$0.03k - $0.035k
2 weeks ago
Worldwide
AI
Entry
Full Time
$145k - $155k
2 weeks ago
United States
AI
Executive
AWS
Git
Full Time
2 weeks ago
United States
AI
Senior
Full Time
$89.865k - $155.767k
2 weeks ago
United States
Product
Mid
Python
Java
AWS
+1 more
Full Time
2 weeks ago
United States
AI
Executive
Git
Full Time
2 weeks ago
United States
AI
Senior
AWS
Git
API
Full Time
2 weeks ago
United States
AI
Executive
AWS
API
Full Time
2 weeks ago
United States
AI
Senior
Full Time
2 weeks ago
United States
AI
Mid
Python
SQL
Full Time
RON 16k - RON 19k
2 weeks ago
United States
AI
Senior
Python
AWS
Full Time
$242k - $302k
2 weeks ago
United States
AI
Executive
API
Full Time
$105k - $235k
2 weeks ago
United States
AI
Senior
AWS
Git
Full Time
$105k - $235k
2 weeks ago
United States
AI
Senior
AWS
Git
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
2 weeks ago
United States
AI
Senior
API
Contract
2 weeks ago
Worldwide
AI
Executive
AWS
API
Contract
2 weeks ago
Worldwide
AI
Executive
AWS
API
Full Time
2 weeks ago
United States
AI
Senior
Full Time
2 weeks ago
United States
AI
Senior
Full Time
2 weeks ago
Worldwide
AI
Senior
AWS