Opens an external site
- Employment type
- Full-time
- Experience level
- Senior · 5+ years
- Posting language
- English
- Working hours
- 40 hours per week
Job summary
The specialist will maintain the organization's AI risk taxonomy and develop evaluation rubrics for safety, fairness, and reliability. They will also conduct independent risk audits and coordinate adversarial testing with the cybersecurity team.
Job details
Responsibilities: Maintains the organization's AI risk taxonomy and assessment methodology, covering safety, fairness, reliability, explainability, robustness, and harmful output risks Develops risk evaluation rubrics for AI-specific risk dimensions (e.g., bias testing protocols, fairness metrics, explainability requirements by use case, drift tolerance thresholds, harmful output tolerances) within the established risk tolerance and acceptance thresholds Develops and maintains templates and standards for risk documentation (model cards, risk assessments, impact analyses, risk scorecards); project teams produce their own documentation using these templates Supports project teams in applying the risk assessment framework and quality gates, escalating high-risk deployments for direct review Executes periodic independent risk audits on a sample basis to verify that federated execution meets the standards; project QAs provide first-line coverage Supports red-teaming and adversarial testing coordination with the Cybersecurity team, focusing on safety, bias, and harmful output dimensions Background & Qualifications: Experience in AI/ML risk management, model risk management, technology risk, or a related analytical function Working knowledge of AI-specific frameworks and legislation (NIST AI RMF, ISO 42001 & 23053, EU AI Act, and the proliferating landscape of US state-level AI legislation) Familiarity with risk assessment across safety, fairness, reliability, explainability, and robustness dimensions Hands-on experience with model evaluation, bias and fairness testing, or AI red-teaming is a plus Skills: AI risk taxonomy and assessment methodology maintenance Developing risk evaluation rubrics: bias testing, fairness metrics, explainability, drift, and harmful output Risk documentation: model cards, risk assessments, impact analyses, and risk scorecards Model evaluation and fairness/safety testing Audit execution and independent risk review Cross-functional collaboration with Engineering and Cybersecurity If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us! It is the policy of Mobility to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, Mobility will provide reasonable accommodations for qualified individuals with disabilities.
What you’ll do
The specialist will maintain the organization's AI risk taxonomy and develop evaluation rubrics for safety, fairness, and reliability. They will also conduct independent risk audits and coordinate adversarial testing with the cybersecurity team.
Requirements
Candidates should have experience in AI/ML risk management or related analytical functions and a working knowledge of AI frameworks like NIST AI RMF and the EU AI Act. Hands-on experience with model evaluation, bias testing, or red-teaming is highly preferred.
Listed skills
- Cross-Functional Collaboration · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- AI Risk Taxonomy
- Risk Assessment Methodology
- Bias Testing
- Fairness Metrics
- Explainability
- Model Cards
- Risk Documentation
- Audit Execution
- NIST AI RMF
- ISO 42001
- EU AI Act
- AI Red-teaming
- Adversarial Testing
- Model Risk Management
- Technology Risk
- Cross-functional Collaboration
- Cross-Functional Collaboration
- Red Teaming
- Quality Gate
- Taxonomy
- Artificial Intelligence Risk
- Artificial Intelligence
- Auditing
- Cyber Security
- Risk Aversion
- Risk Management
- Machine Learning
- Risk Analysis
- Coordinating
- Reliability
- Enthusiasm
Job areas
- Technology
- Security & Safety
- Data & Analytics
- Consulting
- Software
- Risk Management Specialist
- Risk Manager
- Management and Organization Analysts
- Financial Risk Specialists
More jobs from Mobility Global
Senior IGA Engineer - SailPoint IdentityIQ (On-Prem)
- On-site
- London, ON
- Posted Oct 21, 2026
Senior Access Management Engineer
- On-site
- London, ON
- Posted Oct 21, 2026
Senior Identity Integration Engineer
- On-site
- London, ON
- Posted Oct 21, 2026
Business Analyst
- On-site
- London, ON
- Posted Oct 10, 2026
