Back to job search
JA
Jobs AiVerified Job Source

Machine Learning Analyst (Remote)

Analyze structured and unstructured datasets to evaluate and improve the performance of advanced AI systems. Define and validate metrics while investigating model failure modes and edge cases using Python and SQL.

  • Remote
  • Canada
  • Posted Aug 29, 2026
  • 1 position

More jobs you can apply to directly

Similar opportunities posted by employers hiring on Jobs.ca, with no external application form.

Job summary

Role: Machine Learning Analyst (Remote) Location: Remote Job Type: Part-Time Payout: Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a MLE Bench – Data Analyst to work on a part-time basis. This role involves hands-on analytical work with production-like datasets, metrics, and ML outputs to help evaluate, diagnose, and improve the performance of advanced AI systems. The ideal candidate is comfortable working at the intersection of data analysis and machine learning, with strong analytical rigor and the ability to work with real datasets and ML evaluation workflows. Key Responsibilities: • Analyze structured and unstructured datasets generated from ML training, inference, and evaluation pipelines. • Define, compute, and validate metrics used to evaluate model performance and behavior. • Investigate data distributions, model outputs, failure modes, and edge cases relevant to benchmark tasks. • Write and run Python and SQL code to analyze data, create reports, and support evaluation workflows. • Validate data quality, consistency, and correctness across datasets and experiments. Required Skills & Qualifications: • Minimum 3+ years of experience as a data analyst or analytics-focused engineer. • Strong proficiency in Python for data analysis. • Solid experience with SQL and relational datasets. • Experience analyzing ML outputs and evaluation metrics. • Strong understanding of statistics and analytical reasoning. More About the Opportunity: This role offers a unique opportunity to work with a global leader in the Software Development | Technology, Information and Internet | Data Infrastructure and Analytics industry, contributing to benchmark-driven evaluation projects focused on real-world machine learning systems. The position involves collaboration with ML engineers and researchers to design challenging evaluation scenarios. Equal Opportunity Employer: We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications. Apply Now!

What you’ll do

Analyze structured and unstructured datasets to evaluate and improve the performance of advanced AI systems. Define and validate metrics while investigating model failure modes and edge cases using Python and SQL.

Requirements

Requires a minimum of 3+ years of experience as a data analyst or analytics-focused engineer. Proficiency in Python, SQL, and the analysis of ML outputs and evaluation metrics is essential.

Listed skills

  • SQLPreferred
  • Data analysisPreferred
  • PythonPreferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

  • Python
  • SQL
  • Data Analysis
  • Machine Learning Evaluation
  • Statistics
  • Analytical Reasoning
  • Relational Datasets
  • Metric Validation

Job areas

  • Data & Analytics
  • Technology
  • Software
  • Science & Research
  • Engineering

Additional details

Minimum experience
3+ years
Posting language
English
Working hours
40 hours per week
Seniority
Associate