Bachelor's degree in Computer Science, Engineering, Data Science, or related field
Proven experience designing and implementing evaluation methodologies for AI systems
Strong knowledge of metrics for AI performance, robustness, and fairness
Expertise in at least 3 of the following: benchmarking frameworks, statistical validation, synthetic data generation, adversarial testing, explainability techniques
Proficiency in Python and ML libraries (e.g., PyTorch, TensorFlow) and familiarity with evaluation tools (e.g., OpenAI Evals, Dynabench, Promptfoo)
Ability to communicate complex evaluation results to technical and non-technical stakeholders and influence model improvements