Sayari

Requirements

• 10+ years of Machine Learning experience with a focus on Deep Neural Network activities, evaluating model performance & trust.
• 1-2+ years’ experience focused on post-training activities
• 1+ year experience creating benchmarks to evaluate LLMs
• Deep expertise in LLM-as-judge architectures, multi-turn conversation and Graph RAG reasoning
• Ability to design and execute rigorous scoring pipelines and empirical threshold calibrations for agentic systems
• Ability to establish domain-specific evaluation frameworks that measure whether a system can perform the work of human experts rather than just passing general capability benchmarks

Benefits

• 401k Matching
• Certification Support
• Flexible Hours
• Health Insurance
• Home Office Budget
• Learning Budget
• Paid Time Off
• Remote Work

Skills