Opens LinkedIn
- Employment type
- Full-time
- Experience level
- Senior · 5+ years
- Minimum education
- Professional degree
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Mid-Senior level
- Application method
- Direct apply is available
Job summary
Design, develop, and execute system test cases, maintaining traceability among requirements, tests, results, and defects in Azure DevOps. Validate functional, non-functional, system, and performance requirements; coordinate with project teams and suppliers on test planning, defect investigation, retesting, and status reporting.
Job details
Responsibilities Learn the software, system and solution involved as they relate to the assigned test activities. Design, develop and execute test cases, using project specific documentation as input, including requirements defined in Azure DevOps, Test Plans, vendor design documents and Statements of Work (SOWs). Maintain traceability between requirements, test cases, test execution results, and defects within Azure DevOps. Validate the capability of systems to meet functional, non-functional, system and performance requirements. Implement the contents of Test Strategies and Test Plans through a range of software test approaches. Follow and align with standard business operating policies, processes and work instructions. Participate in project status, test planning, test status, defect triage and team meetings. Participate in defect review meetings and technical discussions with suppliers regarding issue investigation, corrective actions and retesting. Develop and provide input to Status Reports. Ensuring deliverables meet the required quality standards. Be available to attend and/or participate in scheduled testing activities and defect triage sessions. Qualifications One of the incumbents shall have at least 7 years of directly related experience and the second shall have at least 5 years of directly related experience, along with the following: Experience validating commercial off-the-shelf (COTS) solutions and integrated systems that support operational, mission-critical, industrial, transportation, defence, simulation, training, or other real-time user-driven environments involving multiple vendors, systems and stakeholders. Experience supporting User Acceptance Testing (UAT), Operational Acceptance Testing (OAT), or equivalent validation and verification activities. Knowledge, Skills and Experience: Knowledge and experience with system testing, test engineering principles and validation of large-scale projects for software and hardware. Experience using Azure DevOps for requirements management, test management, defect tracking and reporting. Experience working with third party suppliers, ensuring adherence to project requirements and quality standards. Ability to develop and execute on test plans/protocols/cases, and report on the test analysis/metrics and provide recommendations to management/supervisors. Analyze and identify test coverage gaps and missing links between requirements and tests, including test procedures developed by other testers. Skill in professional discussions with internal customers, external vendors and management. Skill in writing clear, cohesive, and concise documentation that is easily understandable by colleagues, management, and clients. Skill in communicating clearly in conversation and in presentations to both technical and non-technical staff and management. Knowledge of test maturity models such as TMMI. The Contractors will hold a degree/diploma/certification from an accredited university or college, in Engineering, Computer Sciences/Information Technology, or have an equivalent combination of education and experience Compensation Up to $70/hour “Final compensation will be based on the successful candidate’s skills, experience, qualifications, and contract conditions.” Vacancy We have 2 (two) available positions At Calian, we do not use Artificial Intelligence (AI) to screen or evaluate candidates. AI tools may support backend administrative tasks, but they do not influence hiring decisions. All evaluations and decisions are made by real people on our recruitment team and hiring managers. All applicants are reviewed and only those chosen for an interview will be contacted by our recruiting team. # #ID-DR1#
What you’ll do
Design, develop, and execute system test cases, maintaining traceability among requirements, tests, results, and defects in Azure DevOps. Validate functional, non-functional, system, and performance requirements; coordinate with project teams and suppliers on test planning, defect investigation, retesting, and status reporting.
Requirements
The role requires 5–7 years of directly related experience, including testing COTS solutions and integrated systems in complex, operational or mission-critical environments, and supporting UAT, OAT, or equivalent activities. Candidates need system testing and test engineering experience, Azure DevOps proficiency, supplier collaboration skills, and a relevant degree, diploma, certification, or equivalent education and experience.
Listed skills
- Microsoft Azure · Preferred
- Planning · Preferred
- management · Preferred
- Teams · Preferred
- Software · Preferred
- Technical · Preferred
- Documentation · Preferred
- Validation · Preferred
- Administrative · Preferred
- analysis · Preferred
- Collaboration · Preferred
- Execution · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- System Testing
- Test Engineering
- Test Planning
- Test Case Development
- Test Execution
- Requirements Traceability
- Azure DevOps
- Defect Tracking
- User Acceptance Testing
- Operational Acceptance Testing
- System Validation
- Performance Testing
- Test Coverage Analysis
- Supplier Management
- Technical Communication
- Test Maturity Models
Job areas
- Technology
- Software
- Engineering
- Transportation
- Consulting
More jobs from Calian Group
Manager, RF & Antenna Research and Technology
- On-site
- Ottawa, ON
- Posted Oct 10, 2026
Manager, Mechanical Design and Core Engineering
- On-site
- Ottawa, ON
- Posted Oct 10, 2026
Manager, RF & Antenna Systems
- On-site
- Ottawa, ON
- Posted Oct 10, 2026
Ingénieur mécanique principal / Senior Mechanical Engineer
- On-site
- Vaudreuil-Dorion, QC
- Posted Oct 10, 2026
