Remote Opportunity

Senior - AI Governance & QA Auditor – Data Scientist, AI Systems Audit, Compliance, AI Governance, AI Explainability, Python

Join UPS as a senior professional working remotely from Worldwide. Explore the role, benefits, and apply in one place.

Full Time
$120,000 - $180,000*
4 months ago
Worldwide
AI Governance & Programs
Senior
Python
IBM WatsonX Governance
AI/ML systems
+4 more

Job Description

Before you apply to a job, select your language preference from the options available at the top right of this page.

Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrow—people with a unique combination of skill + passion. If you have the qualities and drive to lead yourself or teams, there are roles ready to cultivate your skills and take you to the next level.

Job Description:

Job Summary

We are seeking a highly skilled AI Governance, and QA Auditor to evaluate, audit, and ensure the responsible, ethical, and compliant use of Artificial Intelligence and Machine Learning systems. This role is central to maintaining trust, fairness, transparency, and regulatory alignment across AI/ML initiatives, while driving continuous improvement in model development, deployment, and monitoring practices. The candidate will collaborate with data scientists, engineers, risk/compliance teams, and business stakeholders to establish and enforce AI governance frameworks, leveraging advanced tools such as IBM Watsonx Governance.

Key Responsibilities

AI Assurance & Quality Auditing

  • Design framework for technical auditing of AI/ML systems that avoid costly mistakes.
  • Conduct independent audits of a variety of AI/ML systems in the areas of Gen AI, Deep Learning, Machine Learning, Natural Language Processing and Computer Vision.
  • Verify compliance with benchmark standards, external regulations, and ethical AI principles.
  • Assess data quality, feature engineering practices, and model development pipelines for reproducibility, fairness, and bias mitigation.
  • Evaluate ML model performance, robustness, explainability, and alignment with intended business outcomes.
  • Review deployment processes, model versioning, and monitoring practices to ensure traceability and accountability.
  • Utilize Watsonx Governance and other enterprise AI governance tools to audit and validate responsible AI practices.

AI Governance & Risk Management

  • Define, implement, and maintain AI governance frameworks, policies, and best practices.
  • Identify AI risks (bias, drift, adversarial attacks, misuse) and recommend mitigation strategies.
  • Ensure compliance with AI regulations and standards (e.g., EU AI Act, NIST AI RMF, ISO 42001, GDPR, industry-specific frameworks).
  • Establish governance checkpoints across the AI lifecycle (data collection, training, validation, deployment, monitoring).
  • Leverage Watsonx Governance for automated policy enforcement, lineage tracking, and audit readiness.

Compliance & Ethical AI

  • Audit AI/ML systems for fairness, inclusivity, accountability, and transparency.
  • Ensure model documentation, datasheets, and audit trails are consistently maintained.
  • Provide assurance reports for regulators, clients, and internal executives.
  • Monitor emerging AI regulations and update governance policies accordingly.

Collaboration & Advisory

  • Partner with Data Science, MLOps, and Product teams to embed assurance-by-design practices.
  • Educate stakeholders on AI risks, governance policies, and responsible AI principles.
  • Act as an internal advisor for audits, compliance reviews, and external certifications.

Qualifications & Skills:

Education

Bachelor’s degree in Computer Science, Data Science, Statistics, Engineering, or a related quantitative field.

Master’s/PhD or certification in AI Governance, Risk & Compliance, or Data Ethics is preferred.

Required Experience

  • 6+ years of overall professional experience, with at least 3 years in AI/ML model development, assurance, risk management, or audit functions.
  • Hands-on expertise with Data Science workflows, ML model evaluation, and MLOps pipelines.
  • Prior experience in regulatory compliance, IT audit, or QA within financial services, healthcare, or other regulated industries is a plus.
  • Technical Skills
  • Strong understanding of machine learning, deep learning, and generative AI.
  • Familiarity with AI auditing tools (e.g., Fairlearn, Aequitas, SHAP, LIME, Explainable AI frameworks).
  • Proficiency in Python, SQL, and model evaluation libraries.
  • Knowledge of cloud platforms (AWS, Azure, GCP) and enterprise governance solutions such as IBM Watsonx Governance, Vertex AI Model Monitoring, and Watson OpenScale.
  • Governance & Regulatory Skills
  • Knowledge of AI risk management frameworks (NIST AI RMF, ISO 42001, OECD AI Principles).
  • Understanding of data protection and privacy laws (GDPR, HIPAA, CCPA).
  • Ability to translate technical findings into executive-level risk and compliance reports.

Soft Skills

  • Strong analytical and critical thinking with attention to detail.
  • Excellent communication and stakeholder management skills.
  • Ability to act as an independent, objective voice in AI governance matters.


Employee Type:
 

Permanent


UPS is committed to providing a workplace free of discrimination, harassment, and retaliation.

Requirements

  • Design framework for technical auditing of AI/ML systems
  • Conduct independent audits of AI/ML systems
  • Verify compliance with benchmark standards
  • Assess data quality, feature engineering practices, and model development pipelines
  • Evaluate ML model performance, robustness, explainability, and alignment with intended business outcomes
  • Review deployment processes, model versioning, and monitoring practices
  • Utilize Watsonx Governance and other enterprise AI governance tools
  • Define, implement, and maintain AI governance frameworks, policies, and best practices

Benefits

  • 401k Matching
  • Certification Support
  • Company Retreats
  • Conference Budget
  • Dental Insurance
  • Employee Assistance Program
  • Employee Discounts
  • Flexible Hours

Skills

Python
IBM WatsonX Governance
AI/ML systems
Data Science
Machine Learning
Natural Language Processing
Computer Vision

About AI-Estimated Salary

The salary range shown was not provided by the employer. Our AI has estimated it based on the job title, required experience, location, and industry standards (confidence: 80%). This estimate should be used as a general guide only and may not reflect the actual compensation. Always confirm salary details directly with the employer during the application process.

Ready to Apply?

Join UPS today

Salary Range (AI-Estimated)*
$120,000 - $180,000
80% confidence
Posted 4 months ago

Explore more remote openings

Browse fresh listings from our global community of remote-friendly teams.

Full Time
$94.8k - $166.2k
5 days ago
United States
Engineering
Senior
Git
Full Time
5 days ago
United States
AI
Senior
Python
AWS
Git
+1 more
Full Time
5 days ago
United States
Data
Mid
Python
API
Full Time
$175.75k - $260k
5 days ago
United States
AI
Executive
AWS
API
Full Time
5 days ago
United States
AI
Mid
API
Full Time
6 days ago
United States
AI
Executive
Git
Full Time
2 weeks ago
Worldwide
AI
Senior
API
Full Time
$145k - $180k
2 weeks ago
United States
AI
Executive
Python
AWS
API
Full Time
$140k - $170k
2 weeks ago
Worldwide
AI
Senior
Python
Git
API
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
2 weeks ago
United States
AI
Executive
Full Time
2 weeks ago
United States
AI
Executive
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
$111.6k - $163.1k
2 weeks ago
United States
AI
Senior
Full Time
$0.03k - $0.035k
2 weeks ago
Worldwide
AI
Entry
Full Time
$145k - $155k
2 weeks ago
United States
AI
Executive
AWS
Git
Full Time
2 weeks ago
United States
AI
Senior
Full Time
$89.865k - $155.767k
2 weeks ago
United States
Product
Mid
Python
Java
AWS
+1 more
Full Time
2 weeks ago
United States
AI
Executive
Git
Full Time
2 weeks ago
United States
AI
Senior
AWS
Git
API
Full Time
2 weeks ago
United States
AI
Executive
AWS
API
Full Time
2 weeks ago
United States
AI
Senior
Full Time
2 weeks ago
United States
AI
Mid
Python
SQL
Full Time
RON 16k - RON 19k
2 weeks ago
United States
AI
Senior
Python
AWS
Full Time
$242k - $302k
2 weeks ago
United States
AI
Executive
API
Full Time
$105k - $235k
2 weeks ago
United States
AI
Senior
AWS
Git
Full Time
$105k - $235k
2 weeks ago
United States
AI
Senior
AWS
Git
Full Time
2 weeks ago
United States
AI
Senior
API
Full Time
2 weeks ago
United States
AI
Senior
API
Contract
2 weeks ago
Worldwide
AI
Executive
AWS
API
Contract
2 weeks ago
Worldwide
AI
Executive
AWS
API
Full Time
2 weeks ago
United States
AI
Senior
Full Time
2 weeks ago
United States
AI
Senior
Full Time
2 weeks ago
Worldwide
AI
Senior
AWS