Remote Opportunity

ML Engineer - GenAI Evaluation

Join eBay as a senior professional working remotely from Netherlands. Explore the role, benefits, and apply in one place.

Full Time
$120,000 - $180,000*
5 weeks ago
Netherlands
AI Governance & Programs
Senior
Python
Machine Learning
Natural Language Processing
+3 more

Job Description

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.

About the role & team:

eBay Core AI is seeking a highly skilled and motivated ML Engineer (GenAI Evaluation & Monitoring) in our Amsterdam office. You will have deep expertise in Applied Science and at least one of the following domains: GenAI Evaluation, Natural Language Processing (NLP), Agentic Systems, Information Retrieval, or Large Language Models (LLMs). We work in small, focused, collaborative project teams and partner with eBay product, engineering, science, platform, and responsible AI teams to deliver scalable, compliant, and high-impact AI products.

In this role, you will focus on developing GenAI evaluation and monitoring tools, conducting science and ML engineering reviews of AI applications and automating those reviews, and defining ML engineering and scientific standards and anti-patterns.

Do you want to shape how GenAI is built and shipped across one of the world’s largest e-commerce platforms? This is a unique opportunity to join a team that defines the technical standards for AI application development at eBay, influencing multiple AI products by reviewing their solutions, establishing best practices and anti-patterns for GenAI systems, and building evaluation and monitoring tools that enable developers to create robust, scalable, and safe AI applications.

What you will accomplish:

  • Design, develop, and deploy advanced AI governance tooling, such as evaluation and monitoring tools for LLM and VLM applications, content moderation systems, and related solutions.

  • Review GenAI applications (e.g., LLM/VLM/Conversational Search/Agentic Systems) from a science and ML engineering perspective, and define ML engineering and scientific best practices and anti-patterns in model development, validation, testing, and deployment to ensure high-quality and scalable AI solutions at eBay.

  • Conduct research on the latest technologies and methodologies in AI governance for LLM/VLM/Agentic applications to drive innovation within the team.

  • Design and build scalable pipelines and workflows for evaluation, monitoring, reproducible datasets, and experimentation.

  • Write maintainable Python code and ensure evaluation processes are reliable and automated.

What you will bring:

  • Master’s degree or PhD in Computer Science, Engineering, Mathematics, or a related field.

  • Demonstrated experience in machine learning, with strong hands-on experience building at least one of the following: LLMs, VLMs, Conversational Search systems, Agentic Systems, or Content Moderation solutions.

  • Proficiency in Python and frameworks such as PyTorch, TensorFlow, or similar.

  • Solid understanding of machine learning algorithms, model architectures, training techniques, and building performant inference pipelines. Experience with model inference optimization techniques and libraries is a plus.

  • Experience with data preprocessing, feature engineering, model evaluation metrics, and large-scale data processing frameworks such as Spark.

  • Excellent analytical and problem-solving skills, and the ability to work in a fast-paced, dynamic environment.

  • Strong communication and collaboration skills, with the ability to explain complex technical concepts to non-technical collaborators, propose creative solutions, and support tracking and delivery within release plans.

  • Publication record in top AI conferences or journals is a strong plus.

  • Experience with AI safety, LLM/VLM/agent guards, content moderation, and policy-driven GenAI evaluation is a strong plus.


What we offer:

  • An opportunity to work on innovative research in GenAI evaluation and monitoring, making significant contributions to both the field and real-world applications.

  • A collaborative and supportive work environment where innovation and creativity are encouraged.

  • Access to state-of-the-art resources and tools to support your research and development work.

Additional Details

eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at [email protected]. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.

 

We use cookies to enhance your experience and may use AI tools for administrative tasks in the hiring process. To learn how we handle your personal data and use AI responsibly, please visit our Talent Privacy Notice, Privacy Center, and AI Hiring Guidelines.

Requirements

  • Design and develop advanced AI governance tooling
  • Review GenAI applications from a science and ML engineering perspective
  • Conduct research on the latest technologies and methodologies in AI governance
  • Design and build scalable pipelines and workflows for evaluation
  • Define ML engineering and scientific best practices and anti-patterns in model development
  • Collaborate with eBay product, engineering, science, platform, and responsible AI teams

Benefits

  • 401k Matching
  • Health Insurance
  • Flexible Hours
  • Paid Time Off
  • Remote Work

Skills

Python
Machine Learning
Natural Language Processing
Large Language Models
Monitoring
GenAI Evaluation

About AI-Estimated Salary

The salary range shown was not provided by the employer. Our AI has estimated it based on the job title, required experience, location, and industry standards (confidence: 80%). This estimate should be used as a general guide only and may not reflect the actual compensation. Always confirm salary details directly with the employer during the application process.

Ready to Apply?

Join eBay today

Salary Range (AI-Estimated)*
$120,000 - $180,000
80% confidence
Posted 5 weeks ago

More AI Governance & Programs roles you might like

Discover similar opportunities from companies that are also hiring remotely.

Full Time
$120,000 - $180,000*
1 day ago
Worldwide
AI Governance & Programs
Senior
Python
Node.JS
Go
+3 more
Full Time
$147k - $211k
1 day ago
Worldwide
AI Governance & Programs
Senior
C++
API design
Stubby
+3 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
Python
Machine Learning
Data Analysis
+4 more

Explore more remote openings

Browse fresh listings from our global community of remote-friendly teams.

Full Time
$228.911k - $471.286k
1 day ago
Worldwide
AI Compliance & Legal
Senior
AI
Machine Learning
Data
+4 more
Full Time
$120,000 - $180,000*
1 day ago
Worldwide
AI Security & Privacy
Senior
Python
Adversarial Machine Learning
Enterprise Security Architecture
+5 more
Full Time
$120,000 - $180,000*
1 day ago
Worldwide
AI Security & Privacy
Senior
Python
Adversarial Machine Learning
Enterprise Security Architecture
+5 more
Full Time
$80,000 - $140,000*
1 day ago
Worldwide
AI Risk & Controls
Mid
Data Analysis
Risk Assessment
Automation
+2 more
Full Time
$120,000 - $180,000*
2 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
Cloud
AI
API
+3 more
Full Time
$100,000 - $150,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
AI
Data governance
Regulatory Compliance
+5 more
Full Time
$80,000 - $140,000*
2 days ago
Germany
Worldwide
Model Risk Management & Validation
Mid
Model Validation
Risk Management
Model Development
+5 more
Full Time
$120,000 - $180,000*
2 days ago
Canada
Worldwide
AI Governance & Programs
Senior
AI
Machine Learning
Risk Management
+3 more
Full Time
$229.9k - $262.4k
2 days ago
United States
Worldwide
AI Governance & Programs
Senior
Python
Machine Learning
Cloud Computing
+3 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
Generative AI
LLMs
prompt engineering
+5 more
Full Time
$108k - $185k
2 days ago
United States
Worldwide
AI Compliance & Legal
Senior
Artificial Intelligence
Generative AI
Machine Learning
+3 more
Full Time
$98.16k - $159.27k
2 days ago
United States
AI Security & Privacy
Senior
Azure Security Engineer
Microsoft Cybersecurity Architect
CISSP
+4 more
Full Time
$108.75k - $200k
2 days ago
United States
Model Risk Management & Validation
Senior
Quantitative models
Risk Management
Model Risk Management
+4 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
Data security & privacy
Access control and permissions
API integrations
+5 more
Full Time
$120,000 - $180,000*
2 days ago
Worldwide
AI Governance & Programs
Senior
AWS
Azure
GCP
+5 more
Contract
$120,000 - $180,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
ISO/IEC 42001
AI Lifecycle Governance
Data governance
+4 more
Contract
$120,000 - $180,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
ISO/IEC 42001
Audit Methodology
Artificial Intelligence Management Systems
+1 more
Full Time
$102.8k - $210.2k
4 days ago
Worldwide
AI Compliance & Legal
Senior
Data Analysis
Business Analysis
Data Management
+5 more
Full Time
$197.4k - $246.75k
4 days ago
Worldwide
AI Governance & Programs
Senior
Machine Learning
Generative AI
Python
+5 more
Full Time
$149.084k - $218.657k
4 days ago
Worldwide
AI Security & Privacy
Senior
AI/ML systems
Governance
Model Risk Management
+5 more
Full Time
$80,000 - $160,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
AI
Machine Learning
Data Science
+5 more
Full Time
$80,000 - $160,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
Pharmacy
Retail Operations
Customer Service
+5 more
Full Time
$80,000 - $160,000*
4 days ago
Worldwide
AI Governance & Programs
Senior
Pharmacy
Retail Operations
Customer Service
+5 more
Full Time
$120,000 - $180,000*
4 days ago
Canada
Worldwide
AI Governance & Programs
Senior
Data governance
AI Governance
Risk Management
+3 more
Full Time
$120,000 - $180,000*
5 days ago
Worldwide
AI Governance & Programs
Senior
Model Validation
Quantitative Analytic Modeling
Risk Management
Full Time
$120,000 - $180,000*
5 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
Responsible AI
AI Governance
Risk Management
+5 more
Full Time
PLN 9.6k - PLN 18k
5 days ago
Worldwide
Model Risk Management & Validation
Senior
Python
VBA
Data Analytics
+4 more
Full Time
$175.1k - $334.75k
5 days ago
United States
Worldwide
AI Security & Privacy
Senior
AI Security
Machine Learning
Cloud Infrastructure
+4 more
Full Time
$102.8k - $210.2k
5 days ago
Worldwide
AI Compliance & Legal
Senior
Data Analysis
Business Analysis
Data Management
+5 more
Full Time
$120,000 - $180,000*
5 days ago
Worldwide
AI Risk & Controls
Senior
Model Validation
Model Risk Management
Machine Learning
+2 more
Full Time
$87.7k - $157.8k
5 days ago
Worldwide
AI Governance & Programs
Senior
API
Risk Management
Compliance
+5 more
Full Time
CAD 61.6k - CAD 113.9k
5 days ago
Canada
Worldwide
Model Risk Management & Validation
Senior
Credit Risk Models
Stress Testing
Loss Forecasting
+4 more
Full Time
$120,000 - $180,000*
5 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
Responsible AI
AI Ethics
AI Security
+5 more
Full Time
$120,000 - $200,000*
5 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
Responsible AI
AI Ethics
AI Compliance
+5 more
Full Time
$120,000 - $180,000*
5 days ago
United Kingdom
Worldwide
AI Governance & Programs
Senior
AI
Machine Learning
Data Science
+4 more
Full Time
PLN 9.6k - PLN 18k
5 days ago
Worldwide
Model Risk Management & Validation
Senior
SAS MRM
Python
VBA
+4 more