About Us Steelhaus Technologies Inc. became one of the fastest growing completions company since its establishment in 2008. Steelhaus boldly drives the market with innovative energy solutions; fusing practical, field-proven experience, adaptable engineering, integrated manufacturing, and uncompromising safety with relentless delivery of unwavering customer service.

Through continuous growth and a collective of “Can Do” attitudes, we’ve created an environment that allows our people to thrive, to learn, to develop and move forward.

About The Role The AI Tool Tester ensures internal AI tools built on Anthropic’s Claude platform function as intended before deployment. Working with the Project Manager and leadership team, the role evaluates tools against their intended purpose, identifies issues, and provides clear feedback on performance and reliability. This position focuses on analytical testing and quality assurance rather than programming and is well suited to someone early in their career with strong curiosity about AI and process improvement.

Position Details

Status: Full-time

Shift: Monday - Friday, 8am - 5pm

Location: Calgary, AB

Duties and Responsibilities

Tool Testing & Validation

• Receive briefings from the executive and project team on newly built Claude-powered tools, including their intended purpose, expected outputs, and key use cases
• Explore and stress-test tools by working through a wide range of inputs, edge cases, and real-world scenarios to evaluate whether they behave as intended
• Identify inconsistencies, errors, unexpected outputs, or gaps between what the tool was designed to do and what it actually does
• Test across different user types and scenarios to ensure tools are reliable and accessible for non-technical staff across our business units

Bug Identification & Reporting

• Document issues clearly and specifically: what you did, what you expected to happen, and what actually happened
• Assign severity levels to issues (minor, moderate, critical) based on their impact on usability and business function
• Maintain an organized log of findings and communicate them to the project team in a structured, easy-to-action format
• Follow up on resolved issues to confirm fixes have worked and no new problems have been introduced

Understanding Claude & AI Behavior

• Develop a working knowledge of how Claude processes inputs and generates responses, including prompt sensitivity, context handling, and output formatting
• Recognize patterns in AI-specific failure modes such as misunderstood instructions, inconsistent outputs, overly verbose responses, or outputs that don’t match the intended business need
• Learn to distinguish between bugs in how a tool is built versus limitations or quirks of the underlying AI model
• Stay current on Claude’s capabilities and updates as Anthropic releases new model versions or features that may affect our tools

Collaboration & Improvement

• Work closely with the Project Manager and internal development resources to communicate findings clearly and help prioritize fixes
• Collaborate with the AI Trainer to understand how end users will interact with tools, and incorporate that perspective into testing scenarios
• Contribute to building a reusable testing checklist and quality standard for future tools as our library grows
• Participate in tool design discussions to flag potential quality issues early, before a tool is fully built

Required Abilities, Knowledge, Experience

• Comfort working with technology and a genuine curiosity about artificial intelligence and how AI tools function
• Strong written and verbal communication skills — you can describe a problem clearly and concisely
• Exceptional attention to detail and an ability to think systematically about how to break something
• A self-directed, organized working style — you can manage your own testing workload, track your findings, and follow through
• Willingness to learn Claude’s platform and Anthropic’s tools hands-on from day one
• Ability to work across teams and communicate findings to both technical and non-technical audiences

Preferred

• Prior experience in quality assurance, software testing, or a technical support role
• Basic familiarity with AI tools such as Claude, ChatGPT, or similar platforms
• Experience using project or issue tracking tools (e.g., Jira, Notion, Trello, or similar)
• A background in manufacturing, operations, or industrial environments is an asset — understanding our business makes testing more effective
• Post-secondary education in a technical, analytical, or business field

Benefits & Perks of Working With Us

• Full comprehensive benefits package including extended health and dental care and wellness and health spending accounts
• Company contribution to your Retirement Savings Plan (RSP)
• Collaborative and energetic workplace culture
• Opportunities for growth within the company through organizational assessments and training

All applicants are thanked for their interest.

Steelhaus Technologies Inc. is an equal opportunity employer.

Steelhaus Technologies Inc. complies with the Personal Information Protection and Electronic Documents Act (PIPEDA). By forwarding your resume to Steelhaus you are consenting to the collection and use of your personal information for this job competition. Your information will be kept strictly confidential.