Remote Opportunity

ML Engineer - GenAI Evaluation

Join eBay as a senior professional working remotely from Netherlands. Explore the role, benefits, and apply in one place.

Full Time
$120,000 - $180,000*
3 months ago
Netherlands
AI Governance & Programs
Senior
Python
Machine Learning
Natural Language Processing
+3 more

Job Description

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.

About the role & team:

eBay Core AI is seeking a highly skilled and motivated ML Engineer (GenAI Evaluation & Monitoring) in our Amsterdam office. You will have deep expertise in Applied Science and at least one of the following domains: GenAI Evaluation, Natural Language Processing (NLP), Agentic Systems, Information Retrieval, or Large Language Models (LLMs). We work in small, focused, collaborative project teams and partner with eBay product, engineering, science, platform, and responsible AI teams to deliver scalable, compliant, and high-impact AI products.

In this role, you will focus on developing GenAI evaluation and monitoring tools, conducting science and ML engineering reviews of AI applications and automating those reviews, and defining ML engineering and scientific standards and anti-patterns.

Do you want to shape how GenAI is built and shipped across one of the world’s largest e-commerce platforms? This is a unique opportunity to join a team that defines the technical standards for AI application development at eBay, influencing multiple AI products by reviewing their solutions, establishing best practices and anti-patterns for GenAI systems, and building evaluation and monitoring tools that enable developers to create robust, scalable, and safe AI applications.

What you will accomplish:

  • Design, develop, and deploy advanced AI governance tooling, such as evaluation and monitoring tools for LLM and VLM applications, content moderation systems, and related solutions.

  • Review GenAI applications (e.g., LLM/VLM/Conversational Search/Agentic Systems) from a science and ML engineering perspective, and define ML engineering and scientific best practices and anti-patterns in model development, validation, testing, and deployment to ensure high-quality and scalable AI solutions at eBay.

  • Conduct research on the latest technologies and methodologies in AI governance for LLM/VLM/Agentic applications to drive innovation within the team.

  • Design and build scalable pipelines and workflows for evaluation, monitoring, reproducible datasets, and experimentation.

  • Write maintainable Python code and ensure evaluation processes are reliable and automated.

What you will bring:

  • Master’s degree or PhD in Computer Science, Engineering, Mathematics, or a related field.

  • Demonstrated experience in machine learning, with strong hands-on experience building at least one of the following: LLMs, VLMs, Conversational Search systems, Agentic Systems, or Content Moderation solutions.

  • Proficiency in Python and frameworks such as PyTorch, TensorFlow, or similar.

  • Solid understanding of machine learning algorithms, model architectures, training techniques, and building performant inference pipelines. Experience with model inference optimization techniques and libraries is a plus.

  • Experience with data preprocessing, feature engineering, model evaluation metrics, and large-scale data processing frameworks such as Spark.

  • Excellent analytical and problem-solving skills, and the ability to work in a fast-paced, dynamic environment.

  • Strong communication and collaboration skills, with the ability to explain complex technical concepts to non-technical collaborators, propose creative solutions, and support tracking and delivery within release plans.

  • Publication record in top AI conferences or journals is a strong plus.

  • Experience with AI safety, LLM/VLM/agent guards, content moderation, and policy-driven GenAI evaluation is a strong plus.


What we offer:

  • An opportunity to work on innovative research in GenAI evaluation and monitoring, making significant contributions to both the field and real-world applications.

  • A collaborative and supportive work environment where innovation and creativity are encouraged.

  • Access to state-of-the-art resources and tools to support your research and development work.

Additional Details

eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at [email protected]. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.

 

We use cookies to enhance your experience and may use AI tools for administrative tasks in the hiring process. To learn how we handle your personal data and use AI responsibly, please visit our Talent Privacy Notice, Privacy Center, and AI Hiring Guidelines.

Requirements

  • Design and develop advanced AI governance tooling
  • Review GenAI applications from a science and ML engineering perspective
  • Conduct research on the latest technologies and methodologies in AI governance
  • Design and build scalable pipelines and workflows for evaluation
  • Define ML engineering and scientific best practices and anti-patterns in model development
  • Collaborate with eBay product, engineering, science, platform, and responsible AI teams

Benefits

  • 401k Matching
  • Health Insurance
  • Flexible Hours
  • Paid Time Off
  • Remote Work

Skills

Python
Machine Learning
Natural Language Processing
Large Language Models
Monitoring
GenAI Evaluation

About AI-Estimated Salary

The salary range shown was not provided by the employer. Our AI has estimated it based on the job title, required experience, location, and industry standards (confidence: 80%). This estimate should be used as a general guide only and may not reflect the actual compensation. Always confirm salary details directly with the employer during the application process.

Ready to Apply?

Join eBay today

Salary Range (AI-Estimated)*
$120,000 - $180,000
80% confidence
Posted 3 months ago

More AI Governance & Programs roles you might like

Discover similar opportunities from companies that are also hiring remotely.

Full Time
$7048.161k - $1061.802k
21 hours ago
United States
Worldwide
AI Governance & Programs
Senior
Python
SQL
AI/ML
+4 more
Full Time
$135k - $150k
23 hours ago
Worldwide
AI Governance & Programs
Mid
Python
Machine Learning
LLM
+4 more
Full Time
$120,000 - $180,000*
1 day ago
Worldwide
AI Governance & Programs
Senior
Data governance
AI Policy
Risk Management
+5 more

Explore more remote openings

Browse fresh listings from our global community of remote-friendly teams.

Full Time
$120,000 - $180,000*
23 hours ago
Worldwide
Americas
AI Security & Privacy
Senior
AI
Machine Learning
Cyber Security
+3 more
Full Time
$150,000 - $250,000*
1 day ago
Worldwide
AI Security & Privacy
Senior
OWASP ZAP
Nmap
Postman
+5 more
Full Time
$150k - $200k
1 day ago
Worldwide
AI Governance & Programs
Mid
AI
Python
Clinical AI
+5 more
Full Time
$120,000 - $180,000*
1 day ago
Australia
Worldwide
AI Governance & Programs
Senior
Data governance
AI Ethics
Regulatory Compliance
+3 more
Full Time
$120,000 - $180,000*
1 day ago
Australia
Worldwide
AI Governance & Programs
Senior
Data governance
AI Ethics
Regulatory Compliance
+3 more
Full Time
$85k - $95k
1 day ago
United States
Model Risk Management & Validation
Senior
Model Risk Management
Quantitative Risk Management
Financial Modeling
+4 more
Full Time
$85k - $95k
1 day ago
United States
Model Risk Management & Validation
Senior
Model Risk Management
Quantitative Risk Management
Financial Modeling
+5 more
Full Time
$80,000 - $140,000*
1 day ago
United States
AI Risk & Controls
Mid
Excel
SQL
Python
+1 more
Full Time
$80,000 - $120,000*
1 day ago
United States
Model Risk Management & Validation
Mid
Excel
SQL
Python
+1 more
Full Time
$129k - $175k
2 days ago
Worldwide
AI Audit / Assurance / Controls Testing
Senior
API
Automation
Python
+3 more
Full Time
$129k - $175k
2 days ago
Worldwide
AI Audit / Assurance / Controls Testing
Senior
API
Automation
Python
+3 more
Full Time
$119.7k - $191.1k
2 days ago
Worldwide
AI Governance & Programs
Senior
Risk Management
Model Risk
Governance
+5 more
Full Time
$120,000 - $180,000*
2 days ago
Ireland
Worldwide
AI Compliance & Legal
Senior
Data Protection
AI Compliance
Regulatory Requirements
+3 more
Full Time
$100,000 - $150,000*
2 days ago
Worldwide
AI Governance & Programs
Mid
AI/ML Concepts
Tableau
JIRA
+1 more
Full Time
$204k - $255k
2 days ago
Worldwide
AI Policy, Enablement & Training
Senior
AI
Machine Learning
Policy Development
+4 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Security & Privacy
Staff
Python
ISO 27001
ISO 27701
+4 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Security & Privacy
Staff
Python
ISO 27001
ISO 27701
+4 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Security & Privacy
Staff
Python
Adversarial Machine Learning
AI Deployment Architectures
+4 more
Full Time
Up to PHP 150k
2 days ago
Worldwide
AI Security & Privacy
Senior
PyTorch
TensorFlow
Containerized Environments
+4 more
Full Time
Up to PHP 150k
2 days ago
Worldwide
AI Security & Privacy
Senior
PyTorch
TensorFlow
Gradient-based attacks
+4 more
Full Time
$209k - $309k
4 days ago
Worldwide
AI Security & Privacy
Senior
API
AI
Security
+1 more
Full Time
$239.5k - $351.5k
4 days ago
Worldwide
AI Security & Privacy
Senior
API
AI
Security
+1 more
Full Time
$230k - $280k
4 days ago
United States
Worldwide
AI Governance & Programs
Senior
OWASP
NIST AI RMF
AI/ML systems
+5 more
Full Time
$230k - $280k
4 days ago
Worldwide
AI Governance & Programs
Senior
Agentic Trust Framework
OWASP
NIST AI RMF
+5 more
Full Time
$120,000 - $180,000*
5 days ago
Worldwide
AI Security & Privacy
Senior
Python
Go
Git
+5 more
Full Time
$159.3k - $273.2k
5 days ago
Worldwide
AI Governance & Programs
Senior
Python
Machine Learning
Data Science
+5 more
Full Time
$120,000 - $180,000*
5 days ago
Worldwide
AI Security & Privacy
Staff
Python
Go
Threat modeling
+3 more
Full Time
$80,000 - $140,000*
5 days ago
Worldwide
AI Governance & Programs
Mid
Responsible AI
ISO/IEC 42001
ISO/IEC 27001
+2 more
Full Time
$120,000 - $180,000*
5 days ago
United States
Worldwide
AI Governance & Programs
Senior
AI Ethics
Risk Management
AI governance frameworks
+5 more
Full Time
$120,000 - $180,000*
6 days ago
Worldwide
AI Security & Privacy
Senior
Security Operations
Cybersecurity
NG-SIEM
+5 more
Full Time
$163k - $237k
6 days ago
Worldwide
AI Governance & Programs
Senior
API
Product Management
AI
+4 more
Full Time
$80,000 - $140,000*
6 days ago
United States
Worldwide
AI Governance & Programs
Mid
Python
Data Analysis
Financial Data
+3 more
Full Time
$80,000 - $140,000*
6 days ago
United States
Worldwide
AI Governance & Programs
Mid
Python
Data Analysis
Machine Learning
+2 more
Full Time
$80,000 - $140,000*
6 days ago
Worldwide
AI Governance & Programs
Mid
Python
Excel
Google Sheets
+4 more
Full Time
$120,000 - $180,000*
6 days ago
Australia
Worldwide
AI Governance & Programs
Senior
AI
Machine Learning
Data Science
+4 more
Full Time
$120,000 - $180,000*
6 days ago
Worldwide
AI Governance & Programs
Senior
AI Governance
Model Risk Management
Regulatory Compliance
+5 more
Full Time
$120,000 - $180,000*
1 weeks ago
Worldwide
AI Governance & Programs
Senior
Python
ML frameworks
LLM/GenAI tooling
+2 more