ByteDance

Requirements

• Proficiency in frameworks for auditing models, including criteria like robustness, fairness, interpretability, alignment, and compliance.
• Familiarity with emerging LLM auditing methodologies such as LLMAuditor (probe generation/answering cycles, human-in-the-loop assessments).
• Conduct audits on the model lifecycle from training through deployment and monitoring, ensuring compliance with quality, performance, fairness, and risk-management standards.
• Identify model vulnerabilities including bias, fairness violations, harmful hallucinations, security risks, and recommend remediation strategies.
• Define and assess model performance metrics (accuracy, precision/recall, F1, calibration, robustness, fairness metrics), measurement of hallucination rates in LLMs, bias/fairness quantification, confidence scoring, and stability analyses.

Benefits

• 401k Matching
• Health Insurance
• Paid Time Off
• Performance Bonus
• Remote Work
• Stock Options

Skills

Requirements

• - Proficiency in frameworks for auditing models, including criteria like robustness, fairness, interpretability, alignment, and compliance.
• - Model Evaluation & Audit Frameworks: conduct audits on the model lifecycle from training through deployment and monitoring, ensuring compliance with quality, performance, fairness, and risk-management standards.
• - Risk Identification & Mitigation: Identify model vulnerabilities including bias, fairness violations, harmful hallucinations, security risks, and recommend remediation strategies.
• - Measurement Metrics & Statistical Validation: Define and assess model performance metrics (accuracy, precision/recall, F1, calibration, robustness, fairness metrics), measurement of hallucination rates in LLMs, bias/fairness quantification, confidence scoring, and stability analyses.
• - Communication & Collaboration: Develop and maintain collaborative working relationships with stakeholders, including data partners and owners across different business verticals.

Benefits

• 401k Matching
• Health Insurance
• Paid Time Off
• Performance Bonus
• Remote Work

Skills

Requirements

• - Proficiency in frameworks for auditing models, including criteria like robustness, fairness, interpretability, alignment, and compliance.
• - Model Evaluation & Audit Frameworks: conduct audits on the model lifecycle from training through deployment and monitoring, ensuring compliance with quality, performance, fairness, and risk-management standards.
• - Risk Identification & Mitigation: Identify model vulnerabilities including bias, fairness violations, harmful hallucinations, security risks, and recommend remediation strategies.
• - Measurement Metrics & Statistical Validation: Define and assess model performance metrics (accuracy, precision/recall, F1, calibration, robustness, fairness metrics), measurement of hallucination rates in LLMs, bias/fairness quantification, confidence scoring, and stability analyses.
• - Communication & Collaboration: Develop and maintain collaborative working relationships with stakeholders, including data partners and owners across different business verticals.

Benefits

• 401k Matching
• Health Insurance
• Paid Time Off
• Performance Bonus
• Remote Work
• Stock Options

Skills

Requirements

• Research and development of technologies on responsible AI
• Perform research on responsible AI and collaborate with experts
• Design and perform theoretical analysis of AI algorithms
• Strong technical skills in AI and related areas
• Passion for pursuing excellence in responsible AI

Benefits

• 401k Matching
• Health Insurance
• Paid Time Off
• Remote Work

Skills