Principal AI Architect

Job summary

Lead the design and evolution of agentic AI architecture, establishing standards and infrastructure for scalable product experiences. Collaborate with engineering and product teams to implement robust AI quality frameworks, evaluation systems, and production feedback loops.

Job details

Principal AI Architect Remote out of Toronto, Ontario CAD $200,000 - $220,000 Base Salary THE COMPANY Our client is a high-growth SaaS technology company at the forefront of applying AI to complex, knowledge-intensive workflows. With a strong investment in agentic AI and next-generation automation, they are building scalable, production-ready systems that transform how organizations interact with content, documents, and enterprise knowledge. This is a rare opportunity for a seasoned AI architect to define the technical foundations of a rapidly evolving AI platform and have a significant impact on the future direction of the business. RESPONSIBILITIES Lead the design and evolution of the company's agentic AI architecture, establishing standards, patterns, and infrastructure for scalable AI-driven product experiences. Build and enhance critical AI infrastructure across evaluation frameworks, testing systems, observability platforms, tracing capabilities, and production agent execution environments. Design and implement agent orchestration layers, multi-agent workflows, reasoning engines, memory systems, planning frameworks, and adaptive feedback mechanisms. Partner closely with engineering teams to review architecture, identify technical risks, and drive best practices without creating delivery bottlenecks. Establish a robust AI quality framework, including evaluation datasets, grading systems, regression testing, release gates, experimentation platforms, and production feedback loops. Collaborate with engineering, machine learning, and product leaders to make informed architectural decisions and ensure reliable delivery of advanced AI capabilities. Mentor senior engineers through design reviews, architecture discussions, and technical leadership, raising standards across the wider engineering organization. Evaluate emerging advancements in agentic AI and apply them to build scalable, measurable, and impactful solutions. SKILLS AND EXPERIENCE Required 10+ years of software engineering experience with substantial expertise designing and delivering production AI systems at Staff, Principal, or equivalent level. Proven experience building and shipping agentic AI products, including multi-agent systems, LLM orchestration, tool-use frameworks, and agent execution environments. Deep expertise in AI evaluation methodologies, including quality rubrics, curated datasets, deterministic and model-based grading, regression testing, and continuous feedback systems. Strong experience with advanced Retrieval-Augmented Generation (RAG) and agentic search architectures, including query decomposition, multi-hop retrieval, hybrid search, reranking, metadata filtering, source routing, evidence validation, citations, and confidence scoring. Strong understanding of large language models, retrieval systems, and modern agent design patterns. Expertise in large-scale systems architecture, cloud-based AI infrastructure, model serving, deployment pipelines, monitoring, and observability. Strong Python development skills and hands-on experience with agent frameworks such as LangChain, LangGraph, Microsoft Agent Framework, or similar technologies. Demonstrated ability to influence and guide engineering organizations of 15-20+ engineers through architecture and technical leadership. Preferred Experience building agent-based systems within SaaS products focused on content, document management, or enterprise knowledge workflows. Experience with cloud-native machine learning infrastructure on AWS or comparable cloud platforms. Prior experience operating as a Principal Architect, Distinguished Engineer, or Staff-plus technical leader in a fast-growth technology environment. BENEFITS Competitive base salary of CAD $200,000 - $220,000. Opportunity to shape the future of a cutting-edge AI platform. High-impact individual contributor role with significant technical ownership. Collaborative, innovation-focused engineering culture. Flexible hybrid working environment. Career growth within a rapidly scaling technology organization. HOW TO APPLY Please register your interest by sending your CV via the Apply link on this page. KEY TERMS Principal AI Infrastructure Architect | Principal Engineer | AI Architecture | Agentic AI | Multi-Agent Systems | LLMs | RAG | Agent Frameworks | LangChain | LangGraph | Microsoft Agent Framework | AI Infrastructure | AI Evaluation | Observability | Tracing | Model Serving | Python | Distributed Systems | SaaS | Machine Learning Platform | AWS | Enterprise AI | Staff Engineer | Principal Architect | AI Quality Engineering | Knowledge Systems | Retrieval Systems | Orchestration Frameworks

What you’ll do

Lead the design and evolution of agentic AI architecture, establishing standards and infrastructure for scalable product experiences. Collaborate with engineering and product teams to implement robust AI quality frameworks, evaluation systems, and production feedback loops.

Requirements

Requires 10+ years of software engineering experience with deep expertise in designing production AI systems and agentic frameworks. Candidates must demonstrate strong proficiency in Python, LLM orchestration, and large-scale systems architecture.

Benefits

• Competitive base salary
• Opportunity to shape the future of a cutting-edge AI platform
• High-impact individual contributor role
• Collaborative engineering culture
• Flexible hybrid working environment
• Career growth

Listed skills

• Amazon Web Services · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Agentic AI
• LLM Orchestration
• Python
• RAG
• System Architecture
• Machine Learning Infrastructure
• Cloud Computing
• AI Evaluation
• Observability
• Distributed Systems
• LangChain
• LangGraph
• Model Serving
• Technical Leadership
• SaaS
• AWS

Job areas

• Technology
• Software
• Engineering
• Data & Analytics
• Management & Leadership

More jobs from Harnham