Remote Opportunity

Senior Applied Scientist - AI Evaluation & Quality Systems

Join Apple as a senior professional working remotely from Worldwide. Explore the role, benefits, and apply in one place.

Full Time
$120,000 - $180,000*
2 months ago
Worldwide
AI Governance & Programs
Senior
Python
Machine Learning
Large Language Models
+4 more

Job Description

Apple Services Engineering (ASE) powers the AI and LLM features behind experiences that hundreds of millions of users love every day. As these systems increasingly rely on human-in-the-loop evaluation, the quality of our products is directly constrained by the quality of our evaluation systems. We believe that to build exceptional AI, you need exceptional mechanisms to validate the signals used to train and evaluate them. DESCRIPTION The Human-centered AI, Data Quality Operations team is looking for a Senior Applied Scientist to join our growing team. We are building the systems and methodologies that make AI evaluation trustworthy, and scalable — directly shaping how Apple develops and validates AI across products and services. In this role, you will develop novel, scalable quality control solutions, working closely with cross-functional teams to ensure the data powering our AI/ML systems meets the highest standards of accuracy, consistency, and relevance. Your work will span two connected problem spaces. The first is the methodology and tooling that generates reliable ground truth and detects quality failures across human annotation and automated evaluation pipelines. The second is the autonomous QA agents that make those methodologies generalizable across teams and use cases. This role demands fluency across research thinking and engineering execution — you will prototype, validate, and ship. A strong point of view on when not to use a model or agent is as valued here as the ability to build one. MINIMUM QUALIFICATIONS 5+ years of industry experience in applied science or machine learning with demonstrated impact on shipped systems Strong hands-on experience with Large Language Models including prompt engineering and applied use cases such as grading, validation, or classification Strong working knowledge of evaluation methodology for generative AI, including LLM-as-a-judge design, meta-evaluation, and failure mode analysis Familiarity with human-in-the-loop evaluation systems and the operational dynamics that affect data quality at scale Hands-on experience designing ground truth generation pipelines across varied task types and annotation modalities Proficiency in Python and relevant ML frameworks, with production experience building, deploying, and monitoring LLM-based pipelines and agents MS or PhD in Computer Science, Machine Learning, Statistics, or a related quantitative field, or equivalent practical experience PREFERRED QUALIFICATIONS PhD in Computer Science, Machine Learning, Statistics, or a related field Experience designing agent architectures that are configurable and extensible by practitioners who did not build them Hands-on experience building anomaly detection systems for evaluation quality, including drift detection, distribution analysis, and systematic bias identification Strong communication skills with the ability to influence technical direction across cross-functional teams Demonstrated passion for leveraging AI to improve work efficiency and scale

Requirements

  • 5+ years of industry experience in applied science or machine learning
  • Strong hands-on experience with Large Language Models
  • Strong working knowledge of evaluation methodology for generative AI
  • Familiarity with human-in-the-loop evaluation systems
  • Proficiency in Python and relevant ML frameworks
  • MS or PhD in Computer Science, Machine Learning, Statistics, or a related quantitative field

Benefits

  • 401k Matching
  • Certification Support
  • Flexible Hours
  • Gym Membership
  • Health Insurance
  • Home Office Budget
  • Learning Budget
  • Paid Time Off

Skills

Python
Machine Learning
Large Language Models
prompt engineering
Generative AI
Evaluation Methodology
Human-in-the-loop Evaluation

About AI-Estimated Salary

The salary range shown was not provided by the employer. Our AI has estimated it based on the job title, required experience, location, and industry standards (confidence: 80%). This estimate should be used as a general guide only and may not reflect the actual compensation. Always confirm salary details directly with the employer during the application process.

Ready to Apply?

Join Apple today

Salary Range (AI-Estimated)*
$120,000 - $180,000
80% confidence
Posted 2 months ago

More AI Governance & Programs roles you might like

Discover similar opportunities from companies that are also hiring remotely.

Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
Data governance
AI Governance
Metadata Management
+5 more
Contract
$100,000 - $150,000*
2 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
AI
Data governance
Compliance
+2 more
Full Time
$100,000 - $150,000*
2 days ago
Worldwide
AI Governance & Programs
Mid
Cybersecurity
AI
Machine Learning
+4 more

Explore more remote openings

Browse fresh listings from our global community of remote-friendly teams.

Full Time
1 day ago
United States
AI
Senior
Full Time
1 day ago
United States
AI
Senior
Python
AWS
Git
Full Time
GBP 91k - GBP 106k
1 day ago
United States
AI
Senior
Python
SQL
API
Full Time
1 day ago
United States
AI
Executive
AWS
Git
API
Full Time
1 day ago
United States
AI
Executive
AWS
Git
API
Full Time
CAD 92.6k - CAD 142.6k
2 days ago
United States
AI
Senior
Git
API
Full Time
$95.1k - $169.8k
2 days ago
United States
AI
Senior
Git
API
Full Time
$124k - $140k
2 days ago
United States
AI
Senior
Git
API
Full Time
$124k - $140k
2 days ago
United States
AI
Senior
Git
API
Full Time
$95.1k - $169.8k
2 days ago
United States
AI
Senior
Git
API
Full Time
CAD 92.6k - CAD 142.6k
2 days ago
United States
AI
Senior
Git
API
Full Time
CAD 92.6k - CAD 142.6k
2 days ago
United States
AI
Senior
Git
API
Full Time
$95.1k - $169.8k
2 days ago
United States
AI
Senior
Git
API
Full Time
$95.1k - $169.8k
2 days ago
United States
AI
Senior
Git
API
Full Time
CAD 92.6k - CAD 142.6k
2 days ago
United States
AI
Senior
Git
API
Full Time
2 days ago
United States
AI
Senior
Git
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Security & Privacy
Senior
AI/ML
Threat modeling
Python
+3 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Security & Privacy
Senior
Cybersecurity
Machine Learning
Cloud Security
+2 more
Full Time
$80,000 - $150,000*
2 days ago
United Kingdom
Worldwide
AI Governance & Programs
Lead
Python
SQL
SAS
+3 more
Full Time
$80,000 - $150,000*
2 days ago
United Kingdom
Worldwide
AI Governance & Programs
Lead
Python
SQL
SAS
+3 more
Full Time
$80,000 - $150,000*
2 days ago
United Kingdom
Worldwide
AI Governance & Programs
Lead
Python
SQL
SAS
+3 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Security & Privacy
Lead
Python
Node.JS
Go
+5 more
Full Time
$120,000 - $180,000*
3 days ago
Worldwide
AI Governance & Programs
Senior
Python
Pandas
Transformers
+4 more
Full Time
$120,000 - $180,000*
3 days ago
Worldwide
AI Governance & Programs
Senior
Python
Pandas
Transformers
+4 more
Full Time
GBP 190k - GBP 225k
3 days ago
Worldwide
AI Security & Privacy
Senior
Compliance
Networking
Data Architecture
+5 more
Full Time
$120,000 - $180,000*
3 days ago
Worldwide
AI Security & Privacy
Senior
AI Security
Machine Learning
Python
+4 more
Contract
$120,000 - $180,000*
3 days ago
Worldwide
AI Governance & Programs
Senior
SQL
Informatica Intelligent Data Management Cloud (IDMC)
Informatica CLAIRE AI
+5 more
Full Time
$138.2k - $224.6k
3 days ago
Worldwide
AI Security & Privacy
Senior
AI/ML Risks
Model Connectivity & Secure Deployment
AI Lifecycle Security
+5 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
Machine Learning
Data governance
Model Risk
+5 more
Full Time
$120,000 - $180,000*
4 days ago
United Kingdom
AI Governance & Programs
Staff
AI Governance
Cloud Security
Product Management
+2 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Security & Privacy
Senior
Cloud Security
AI Security
DevSecOps
+4 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Security & Privacy
Senior
Cloud Security
AI Security
DevSecOps
+4 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Security & Privacy
Senior
Cloud Security
AI Security
DevSecOps
+4 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Security & Privacy
Senior
Cloud Security
AI Security
DevSecOps
+4 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Security & Privacy
Senior
Cloud Security
AI Security
DevSecOps
+4 more
Full Time
$120,000 - $200,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
Generative AI
Swift
Objective C
+4 more