Remote Opportunity

Staff Machine Learning Platform Engineer, AI Evaluation

Join Apple as a staff professional working remotely from Worldwide. Explore the role, benefits, and apply in one place.

Full Time
$120,000 - $200,000*
2 months ago
Worldwide
AI Governance & Programs
Staff
Python
Pandas
API design
+5 more

Job Description

Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking a staff machine learning platform engineer to lead the architectural design and development of the high availability services and internal tools powering self-service evaluation at scale. You will partner with researchers to operationalize their innovations, transforming complex workflows into intuitive, developer-first platforms. We are looking for builders who thrive in the ambiguity of new initiatives and are passionate about creating scalable infrastructure. DESCRIPTION You will join the engineering team responsible for democratizing AI evaluation across the organization. Your focus will be on developing the developer experience—architecting and implementing the APIs, SDKs, and platform services that turn complex evaluation metrics into simple, self-service calls. You will work hand-in-hand with researchers to operationalize sophisticated measurement techniques, ensuring they scale reliably within our high-availability infrastructure. In this role, you will drive the engineering standards for a new organization, upholding the code quality, automation, and testing rigor required to support the rapid evolution of Generative AI and Agentic systems. MINIMUM QUALIFICATIONS 8+ years of hands-on software engineering experience, with a track record of owning the technical direction of a platform or infrastructure domain. Strong proficiency in the Python ecosystem (e.g., FastAPI, Pydantic, Pandas). You write production-grade code and lead architectural discussions on day one. Customer Obsession & Product Thinking: You have owned the technical roadmap for an internal platform, presented it to senior stakeholders, and shipped against it. You independently translate vague requirements from other teams into concrete engineering specifications and platform roadmaps. Demonstrated experience leading technical partnerships with Data Scientists or Researchers: You have taken research code and shipped it as a production service and built the abstractions, testing frameworks, and deployment pipelines that made the next handoff faster than the last.. Strong expertise in API Design & Platform Infrastructure: You have designed and owned APIs and SDKs that other developers rely on, with a focus on versioning, backward compatibility, and developer experience at scale. Operational excellence background: You have architected and owned CI/CD pipelines, containerization (Docker/Kubernetes), and monitoring (Datadog/Prometheus) for production services, and have been accountable for their reliability. Bachelors in Computer Science or related field, Masters preferred. PREFERRED QUALIFICATIONS Deep familiarity with AI Evaluation Frameworks: You have built, extended, or contributed to modern evaluation tools like DeepEval, Ragas, TruLens, or LangSmith. You understand how to implement and scale model-based evaluation workflows across a large organization. Evaluation Service Deployment: Own the deployment, scaling, and operational health of evaluation services in production - including high-throughput evaluation job orchestration (queueing, prioritization, concurrency, auto-scaling), and defining SLAs for evaluation pipeline latency and availability. Observability & Reliability: Experience instrumenting production ML evaluation pipelines including tracking evaluation job throughput, queue depth, judge model latency SLAs, scoring drift over time, and failure modes specific to non-deterministic LLM-based evaluation workflows. Deep understanding of Generative AI & Agents: You understand the engineering challenges of relying on LLMs and Agents as software components—specifically managing token economics, handling rate limits, and evaluating non-deterministic, multi-step reasoning capabilities. You have built production systems that depend on these components and have solved these problems at scale. Builder Experience: You have thrived in startup-like environments, navigating high ambiguity to deliver complex technical roadmaps from scratch.

Requirements

  • 8+ years of hands-on software engineering experience
  • Strong proficiency in the Python ecosystem
  • Customer Obsession & Product Thinking
  • Demonstrated experience leading technical partnerships with Data Scientists or Researchers
  • Strong expertise in API Design & Platform Infrastructure
  • Operational excellence background
  • Bachelors in Computer Science or related field, Masters preferred

Benefits

  • 401k Matching
  • Certification Support
  • Company Retreats
  • Conference Budget
  • Coworking Space
  • Dental Insurance
  • Disability Insurance
  • Employee Assistance Program

Skills

Python
Pandas
API design
Docker
Kubernetes
FastAPI
Pydantic
Platform Infrastructure

About AI-Estimated Salary

The salary range shown was not provided by the employer. Our AI has estimated it based on the job title, required experience, location, and industry standards (confidence: 80%). This estimate should be used as a general guide only and may not reflect the actual compensation. Always confirm salary details directly with the employer during the application process.

Ready to Apply?

Join Apple today

Salary Range (AI-Estimated)*
$120,000 - $200,000
80% confidence
Posted 2 months ago

More AI Governance & Programs roles you might like

Discover similar opportunities from companies that are also hiring remotely.

Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
Data governance
AI Governance
Metadata Management
+5 more
Contract
$100,000 - $150,000*
2 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
AI
Data governance
Compliance
+2 more
Full Time
$100,000 - $150,000*
2 days ago
Worldwide
AI Governance & Programs
Mid
Cybersecurity
AI
Machine Learning
+4 more

Explore more remote openings

Browse fresh listings from our global community of remote-friendly teams.

Full Time
1 day ago
United States
AI
Senior
Full Time
1 day ago
United States
AI
Senior
Python
AWS
Git
Full Time
GBP 91k - GBP 106k
1 day ago
United States
AI
Senior
Python
SQL
API
Full Time
1 day ago
United States
AI
Executive
AWS
Git
API
Full Time
1 day ago
United States
AI
Executive
AWS
Git
API
Full Time
CAD 92.6k - CAD 142.6k
2 days ago
United States
AI
Senior
Git
API
Full Time
$95.1k - $169.8k
2 days ago
United States
AI
Senior
Git
API
Full Time
$124k - $140k
2 days ago
United States
AI
Senior
Git
API
Full Time
$124k - $140k
2 days ago
United States
AI
Senior
Git
API
Full Time
$95.1k - $169.8k
2 days ago
United States
AI
Senior
Git
API
Full Time
CAD 92.6k - CAD 142.6k
2 days ago
United States
AI
Senior
Git
API
Full Time
CAD 92.6k - CAD 142.6k
2 days ago
United States
AI
Senior
Git
API
Full Time
$95.1k - $169.8k
2 days ago
United States
AI
Senior
Git
API
Full Time
$95.1k - $169.8k
2 days ago
United States
AI
Senior
Git
API
Full Time
CAD 92.6k - CAD 142.6k
2 days ago
United States
AI
Senior
Git
API
Full Time
2 days ago
United States
AI
Senior
Git
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Security & Privacy
Senior
AI/ML
Threat modeling
Python
+3 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Security & Privacy
Senior
Cybersecurity
Machine Learning
Cloud Security
+2 more
Full Time
$80,000 - $150,000*
2 days ago
United Kingdom
Worldwide
AI Governance & Programs
Lead
Python
SQL
SAS
+3 more
Full Time
$80,000 - $150,000*
2 days ago
United Kingdom
Worldwide
AI Governance & Programs
Lead
Python
SQL
SAS
+3 more
Full Time
$80,000 - $150,000*
2 days ago
United Kingdom
Worldwide
AI Governance & Programs
Lead
Python
SQL
SAS
+3 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Security & Privacy
Lead
Python
Node.JS
Go
+5 more
Full Time
$120,000 - $180,000*
3 days ago
Worldwide
AI Governance & Programs
Senior
Python
Pandas
Transformers
+4 more
Full Time
$120,000 - $180,000*
3 days ago
Worldwide
AI Governance & Programs
Senior
Python
Pandas
Transformers
+4 more
Full Time
GBP 190k - GBP 225k
3 days ago
Worldwide
AI Security & Privacy
Senior
Compliance
Networking
Data Architecture
+5 more
Full Time
$120,000 - $180,000*
3 days ago
Worldwide
AI Security & Privacy
Senior
AI Security
Machine Learning
Python
+4 more
Contract
$120,000 - $180,000*
3 days ago
Worldwide
AI Governance & Programs
Senior
SQL
Informatica Intelligent Data Management Cloud (IDMC)
Informatica CLAIRE AI
+5 more
Full Time
$138.2k - $224.6k
3 days ago
Worldwide
AI Security & Privacy
Senior
AI/ML Risks
Model Connectivity & Secure Deployment
AI Lifecycle Security
+5 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
Machine Learning
Data governance
Model Risk
+5 more
Full Time
$120,000 - $180,000*
4 days ago
United Kingdom
AI Governance & Programs
Staff
AI Governance
Cloud Security
Product Management
+2 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Security & Privacy
Senior
Cloud Security
AI Security
DevSecOps
+4 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Security & Privacy
Senior
Cloud Security
AI Security
DevSecOps
+4 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Security & Privacy
Senior
Cloud Security
AI Security
DevSecOps
+4 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Security & Privacy
Senior
Cloud Security
AI Security
DevSecOps
+4 more
Full Time
$120,000 - $180,000*
4 days ago
Worldwide
AI Security & Privacy
Senior
Cloud Security
AI Security
DevSecOps
+4 more
Full Time
$120,000 - $200,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
Generative AI
Swift
Objective C
+4 more