Remote Opportunity

ML Engineer - GenAI Evaluation

Join eBay as a senior professional working remotely from Netherlands. Explore the role, benefits, and apply in one place.

Full Time
$120,000 - $180,000*
5 months ago
Netherlands
AI Governance & Programs
Senior
Python
Machine Learning
Natural Language Processing
+3 more

Job Description

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.

About the role & team:

eBay Core AI is seeking a highly skilled and motivated ML Engineer (GenAI Evaluation & Monitoring) in our Amsterdam office. You will have deep expertise in Applied Science and at least one of the following domains: GenAI Evaluation, Natural Language Processing (NLP), Agentic Systems, Information Retrieval, or Large Language Models (LLMs). We work in small, focused, collaborative project teams and partner with eBay product, engineering, science, platform, and responsible AI teams to deliver scalable, compliant, and high-impact AI products.

In this role, you will focus on developing GenAI evaluation and monitoring tools, conducting science and ML engineering reviews of AI applications and automating those reviews, and defining ML engineering and scientific standards and anti-patterns.

Do you want to shape how GenAI is built and shipped across one of the world’s largest e-commerce platforms? This is a unique opportunity to join a team that defines the technical standards for AI application development at eBay, influencing multiple AI products by reviewing their solutions, establishing best practices and anti-patterns for GenAI systems, and building evaluation and monitoring tools that enable developers to create robust, scalable, and safe AI applications.

What you will accomplish:

  • Design, develop, and deploy advanced AI governance tooling, such as evaluation and monitoring tools for LLM and VLM applications, content moderation systems, and related solutions.

  • Review GenAI applications (e.g., LLM/VLM/Conversational Search/Agentic Systems) from a science and ML engineering perspective, and define ML engineering and scientific best practices and anti-patterns in model development, validation, testing, and deployment to ensure high-quality and scalable AI solutions at eBay.

  • Conduct research on the latest technologies and methodologies in AI governance for LLM/VLM/Agentic applications to drive innovation within the team.

  • Design and build scalable pipelines and workflows for evaluation, monitoring, reproducible datasets, and experimentation.

  • Write maintainable Python code and ensure evaluation processes are reliable and automated.

What you will bring:

  • Master’s degree or PhD in Computer Science, Engineering, Mathematics, or a related field.

  • Demonstrated experience in machine learning, with strong hands-on experience building at least one of the following: LLMs, VLMs, Conversational Search systems, Agentic Systems, or Content Moderation solutions.

  • Proficiency in Python and frameworks such as PyTorch, TensorFlow, or similar.

  • Solid understanding of machine learning algorithms, model architectures, training techniques, and building performant inference pipelines. Experience with model inference optimization techniques and libraries is a plus.

  • Experience with data preprocessing, feature engineering, model evaluation metrics, and large-scale data processing frameworks such as Spark.

  • Excellent analytical and problem-solving skills, and the ability to work in a fast-paced, dynamic environment.

  • Strong communication and collaboration skills, with the ability to explain complex technical concepts to non-technical collaborators, propose creative solutions, and support tracking and delivery within release plans.

  • Publication record in top AI conferences or journals is a strong plus.

  • Experience with AI safety, LLM/VLM/agent guards, content moderation, and policy-driven GenAI evaluation is a strong plus.


What we offer:

  • An opportunity to work on innovative research in GenAI evaluation and monitoring, making significant contributions to both the field and real-world applications.

  • A collaborative and supportive work environment where innovation and creativity are encouraged.

  • Access to state-of-the-art resources and tools to support your research and development work.

Additional Details

eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at [email protected]. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.

 

We use cookies to enhance your experience and may use AI tools for administrative tasks in the hiring process. To learn how we handle your personal data and use AI responsibly, please visit our Talent Privacy Notice, Privacy Center, and AI Hiring Guidelines.

Requirements

  • Design and develop advanced AI governance tooling
  • Review GenAI applications from a science and ML engineering perspective
  • Conduct research on the latest technologies and methodologies in AI governance
  • Design and build scalable pipelines and workflows for evaluation
  • Define ML engineering and scientific best practices and anti-patterns in model development
  • Collaborate with eBay product, engineering, science, platform, and responsible AI teams

Benefits

  • 401k Matching
  • Health Insurance
  • Flexible Hours
  • Paid Time Off
  • Remote Work

Skills

Python
Machine Learning
Natural Language Processing
Large Language Models
Monitoring
GenAI Evaluation

About AI-Estimated Salary

The salary range shown was not provided by the employer. Our AI has estimated it based on the job title, required experience, location, and industry standards (confidence: 80%). This estimate should be used as a general guide only and may not reflect the actual compensation. Always confirm salary details directly with the employer during the application process.

Ready to Apply?

Join eBay today

Salary Range (AI-Estimated)*
$120,000 - $180,000
80% confidence
Posted 5 months ago

Explore more remote openings

Browse fresh listings from our global community of remote-friendly teams.

Full Time
$94.8k - $166.2k
4 days ago
United States
Engineering
Senior
Git
Full Time
5 days ago
United States
AI
Senior
Python
AWS
Git
+1 more
Full Time
5 days ago
United States
Data
Mid
Python
API
Full Time
$175.75k - $260k
5 days ago
United States
AI
Executive
AWS
API
Full Time
5 days ago
United States
AI
Mid
API
Full Time
5 days ago
United States
AI
Executive
Git
Full Time
2 weeks ago
Worldwide
AI
Senior
API
Full Time
$145k - $180k
2 weeks ago
United States
AI
Executive
Python
AWS
API
Full Time
$140k - $170k
2 weeks ago
Worldwide
AI
Senior
Python
Git
API
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
2 weeks ago
United States
AI
Executive
Full Time
2 weeks ago
United States
AI
Executive
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
$111.6k - $163.1k
2 weeks ago
United States
AI
Senior
Full Time
$0.03k - $0.035k
2 weeks ago
Worldwide
AI
Entry
Full Time
$145k - $155k
2 weeks ago
United States
AI
Executive
AWS
Git
Full Time
2 weeks ago
United States
AI
Senior
Full Time
$89.865k - $155.767k
2 weeks ago
United States
Product
Mid
Python
Java
AWS
+1 more
Full Time
2 weeks ago
United States
AI
Executive
Git
Full Time
2 weeks ago
United States
AI
Senior
AWS
Git
API
Full Time
2 weeks ago
United States
AI
Executive
AWS
API
Full Time
2 weeks ago
United States
AI
Senior
Full Time
2 weeks ago
United States
AI
Mid
Python
SQL
Full Time
RON 16k - RON 19k
2 weeks ago
United States
AI
Senior
Python
AWS
Full Time
$242k - $302k
2 weeks ago
United States
AI
Executive
API
Full Time
$105k - $235k
2 weeks ago
United States
AI
Senior
AWS
Git
Full Time
$105k - $235k
2 weeks ago
United States
AI
Senior
AWS
Git
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
2 weeks ago
United States
AI
Senior
API
Contract
2 weeks ago
Worldwide
AI
Executive
AWS
API
Contract
2 weeks ago
Worldwide
AI
Executive
AWS
API
Full Time
2 weeks ago
United States
AI
Senior
Full Time
2 weeks ago
United States
AI
Senior
Full Time
2 weeks ago
Worldwide
AI
Senior
AWS