Remote Opportunity

Human AI Evaluation Specialist

Join Virtusa as a mid professional working remotely from India. Explore the role, benefits, and apply in one place.

Full Time
$80,000 - $120,000*
2 months ago
India
AI Governance & Programs
Mid
AI evaluation frameworks
Data labeling
Quality rubrics
+4 more

Job Description

Human AI Evaluation Specialist - (CREQ245208)

Description

 

Human AI Evaluation Specialist

Role Focus: Human-in-the-loop Validation · Model Output Quality

Role Summary

Human AI Evaluation Specialists will perform structured human evaluation of Gemini AI outputs by labeling, rating, and providing qualitative feedback on model relevance, correctness, safety, and enterprise usability.

Key Responsibilities

Perform manual evaluation of AI-generated responses

Label datasets for training and validation

Apply quality rubrics and evaluation guidelines

Identify hallucinations, bias, and factual errors

Provide structured feedback for model improvements

Support benchmark creation and golden dataset validation

Required Skills & Experience

2+ years in content review, data labeling, QA, or AI evaluation

Strong analytical and critical thinking skills

Excellent written communication skills

Familiarity with AI evaluation frameworks is preferred

High attention to detail

   

Primary Location

: IN-AP-Hyderabad

Schedule

: Full Time

Employee Status

: Individual Contributor

Job Type

: Experienced

Travel

: No

Job Posting

: 11/02/2026, 9:09:08 AM

Requirements

  • 2+ years in content review, data labeling, QA, or AI evaluation
  • Strong analytical and critical thinking skills
  • Excellent written communication skills
  • Familiarity with AI evaluation frameworks
  • High attention to detail
  • Perform manual evaluation of AI-generated responses
  • Label datasets for training and validation

Benefits

  • Health Insurance
  • Dental Insurance
  • Disability Insurance
  • Employee Assistance Program
  • Employee Discounts
  • Flexible Hours
  • Gym Membership

Skills

AI evaluation frameworks
Data labeling
Quality rubrics
Model relevance
Model correctness
Model safety
Model usability

About AI-Estimated Salary

The salary range shown was not provided by the employer. Our AI has estimated it based on the job title, required experience, location, and industry standards (confidence: 80%). This estimate should be used as a general guide only and may not reflect the actual compensation. Always confirm salary details directly with the employer during the application process.

Ready to Apply?

Join Virtusa today

Salary Range (AI-Estimated)*
$80,000 - $120,000
80% confidence
Posted 2 months ago

More AI Governance & Programs roles you might like

Discover similar opportunities from companies that are also hiring remotely.

Full Time
$120,000 - $180,000*
1 day ago
Worldwide
AI Governance & Programs
Senior
Python
Node.JS
Go
+3 more
Full Time
$147k - $211k
1 day ago
Worldwide
AI Governance & Programs
Senior
C++
API design
Stubby
+3 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
Python
Machine Learning
Data Analysis
+4 more

Explore more remote openings

Browse fresh listings from our global community of remote-friendly teams.

Full Time
$228.911k - $471.286k
1 day ago
Worldwide
AI Compliance & Legal
Senior
AI
Machine Learning
Data
+4 more
Full Time
$120,000 - $180,000*
1 day ago
Worldwide
AI Security & Privacy
Senior
Python
Adversarial Machine Learning
Enterprise Security Architecture
+5 more
Full Time
$120,000 - $180,000*
1 day ago
Worldwide
AI Security & Privacy
Senior
Python
Adversarial Machine Learning
Enterprise Security Architecture
+5 more
Full Time
$80,000 - $140,000*
1 day ago
Worldwide
AI Risk & Controls
Mid
Data Analysis
Risk Assessment
Automation
+2 more
Full Time
$120,000 - $180,000*
2 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
Cloud
AI
API
+3 more
Full Time
$100,000 - $150,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
AI
Data governance
Regulatory Compliance
+5 more
Full Time
$80,000 - $140,000*
2 days ago
Germany
Worldwide
Model Risk Management & Validation
Mid
Model Validation
Risk Management
Model Development
+5 more
Full Time
$120,000 - $180,000*
2 days ago
Canada
Worldwide
AI Governance & Programs
Senior
AI
Machine Learning
Risk Management
+3 more
Full Time
$229.9k - $262.4k
2 days ago
United States
Worldwide
AI Governance & Programs
Senior
Python
Machine Learning
Cloud Computing
+3 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
Generative AI
LLMs
prompt engineering
+5 more
Full Time
$108k - $185k
2 days ago
United States
Worldwide
AI Compliance & Legal
Senior
Artificial Intelligence
Generative AI
Machine Learning
+3 more
Full Time
$98.16k - $159.27k
2 days ago
United States
AI Security & Privacy
Senior
Azure Security Engineer
Microsoft Cybersecurity Architect
CISSP
+4 more
Full Time
$108.75k - $200k
2 days ago
United States
Model Risk Management & Validation
Senior
Quantitative models
Risk Management
Model Risk Management
+4 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
Data security & privacy
Access control and permissions
API integrations
+5 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
AWS
Azure
GCP
+5 more
Contract
$120,000 - $180,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
ISO/IEC 42001
AI Lifecycle Governance
Data governance
+4 more
Contract
$120,000 - $180,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
ISO/IEC 42001
Audit Methodology
Artificial Intelligence Management Systems
+1 more
Full Time
$102.8k - $210.2k
4 days ago
Worldwide
AI Compliance & Legal
Senior
Data Analysis
Business Analysis
Data Management
+5 more
Full Time
$197.4k - $246.75k
4 days ago
Worldwide
AI Governance & Programs
Senior
Machine Learning
Generative AI
Python
+5 more
Full Time
$149.084k - $218.657k
4 days ago
Worldwide
AI Security & Privacy
Senior
AI/ML systems
Governance
Model Risk Management
+5 more
Full Time
$80,000 - $160,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
AI
Machine Learning
Data Science
+5 more
Full Time
$80,000 - $160,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
Pharmacy
Retail Operations
Customer Service
+5 more
Full Time
$80,000 - $160,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
Pharmacy
Retail Operations
Customer Service
+5 more
Full Time
$120,000 - $180,000*
4 days ago
Canada
Worldwide
AI Governance & Programs
Senior
Data governance
AI Governance
Risk Management
+3 more
Full Time
$120,000 - $180,000*
5 days ago
Worldwide
AI Governance & Programs
Senior
Model Validation
Quantitative Analytic Modeling
Risk Management
Full Time
$120,000 - $180,000*
5 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
Responsible AI
AI Governance
Risk Management
+5 more
Full Time
PLN 9.6k - PLN 18k
5 days ago
Worldwide
Model Risk Management & Validation
Senior
Python
VBA
Data Analytics
+4 more
Full Time
$175.1k - $334.75k
5 days ago
United States
Worldwide
AI Security & Privacy
Senior
AI Security
Machine Learning
Cloud Infrastructure
+4 more
Full Time
$102.8k - $210.2k
5 days ago
Worldwide
AI Compliance & Legal
Senior
Data Analysis
Business Analysis
Data Management
+5 more
Full Time
$120,000 - $180,000*
5 days ago
Worldwide
AI Risk & Controls
Senior
Model Validation
Model Risk Management
Machine Learning
+2 more
Full Time
$87.7k - $157.8k
5 days ago
Worldwide
AI Governance & Programs
Senior
API
Risk Management
Compliance
+5 more
Full Time
CAD 61.6k - CAD 113.9k
5 days ago
Canada
Worldwide
Model Risk Management & Validation
Senior
Credit Risk Models
Stress Testing
Loss Forecasting
+4 more
Full Time
$120,000 - $180,000*
5 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
Responsible AI
AI Ethics
AI Security
+5 more
Full Time
$120,000 - $200,000*
5 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
Responsible AI
AI Ethics
AI Compliance
+5 more
Full Time
$120,000 - $180,000*
5 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
AI
Machine Learning
Data Science
+4 more
Full Time
PLN 9.6k - PLN 18k
5 days ago
Worldwide
Model Risk Management & Validation
Senior
SAS MRM
Python
VBA
+4 more