Company Overview

Agility PR Solutions provides today’s communicators with powerful and intuitive media outreach, monitoring, and measurement solutions. For almost twenty years, Agility has helped clients from across industries and continents discover relevant journalists and influencers, make meaningful connections with the media, amplify their stories, monitor media coverage and social conversations, and report on the impact of their public relations activities. Agility is one of the fastest-growing companies in the PR tech space and it’s recognized by users on G2 for ease of use, quick implementation, and outstanding customer service.

We are a remote-first company, with colleagues based across vibrant cities in Canada, the US, the UK, the Philippines, and India. We are intentional in helping our teams realize their full potential, and continue to invest in their learning and development, career progression, offering competitive pay and benefits, enabling leadership and work environment.

Our Approach to AI & Engineering

At Agility PR Solutions, we use AI to scale high-quality work, not to replace human judgment. Our internal AI agents support teams across the business, and we believe the best results come from pairing automation with thoughtful human evaluation.

This role is designed for someone who is curious, detail-oriented, and interested in how AI systems improve over time. You enjoy reviewing work critically, identifying patterns, and contributing structured feedback that helps technology teams iterate faster and more responsibly.

How You'll Make an Impact

We’re seeking an AI Quality Analyst to support the evaluation and continuous improvement of internal AI agents used across our platform. This is a junior, hands-on role within the Engineering department, focused on acting as a key human-in-the-loop for AI development.

You’ll review AI-generated outputs, identify inaccuracies or inconsistencies, and document clear, actionable feedback that helps Engineering improve model accuracy, reliability, and consistency. Your work will directly support faster iteration cycles and higher-quality automation across the business.

What You'll Get to Do

• Review and evaluate outputs produced by internal AI agents across a range of use cases.
• Assess whether AI-generated responses are accurate, consistent, and supported by appropriate sources or logic.
• Identify patterns in errors, inconsistencies, or hallucinations, including repeated phrasing or recurring failure modes.
• Document findings clearly and consistently, including what was corrected, why a change was required, and any observed trends.
• Provide structured, actionable feedback to Engineering to support model improvement and training.
• Partner with Engineering and QA teams to refine evaluation processes and quality standards.
• Contribute to the development of lightweight guidelines and best practices for AI quality review.
• Support additional AI agent initiatives as new use cases are introduced across the organization.
• Other duties as required.

Why You'll Bring

• Early-career professional experience in areas such as technical support, quality assurance, data quality, operations analysis, or systems support.
• Strong attention to detail and comfort reviewing large volumes of information.
• Ability to identify patterns, explain why an output is incorrect, and articulate feedback clearly.
• Comfort learning new tools, platforms, and internal systems quickly.
• Clear written communication skills, particularly for documentation and structured feedback.
• Genuine interest in AI, automation, and the role humans play in evaluating and improving intelligent systems.

Nice to Have

• Experience working with AI-powered tools or automated systems.
• Familiarity with QA methodologies, evaluation frameworks, or quality review processes.
• Exposure to SaaS products or internal tooling environments.

Why You’ll Love It Here

• Fully remote, flexible work environment.
• Collaborative, supportive engineering culture.
• Health, dental, and vision benefits.
• RRSP matching program.
• Employee Assistance Program (EAP).
• Career development and learning opportunities.
• Paid vacation and sick days.
• Summer Flex Fridays and a company-wide break between Christmas and New Year’s.
• No internal meetings on Fridays.

Compensation for this role is expected to fall within the range of $45,000–$55,000 CAD annually. Final offers will reflect experience, skills, and internal equity.

This is for a vacant position.

AI Usage

AI is central to this role, and you will work closely with AI-generated outputs on a daily basis. AI tools are used to support efficiency and scale, while humans remain responsible for evaluation, judgment, and improvement.

AI does not make decisions at Agility. All decisions are made by people, applying sound judgment and equitable practices.

We believe technology should amplify human expertise, not replace it.

At Agility, we strive every day to build a more inclusive work environment and introduce tools that enable it. We strongly encourage applications from all people regardless of race, religion, gender, age, disability status or sexual orientation.

Even if you find yourself not checking all the boxes of our listed requirements but you are excited about this opportunity, we'd love to hear from you anyway. Our Talent Acquisition team will review your application for this role, and other potential role matches open now or in the future.

If, at any stage of the application process, you require accommodation owing to disability or a medical need, please let us know at careers@agilitypr.com for us to make appropriate arrangements.

Thank you for your time in reviewing this opportunity, and we hope to hear from you should you find this the right fit!