Senior AI / Software Architect
Lead the design of scalable, secure, cloud-based AI and automation solutions for enterprise and public-sector clients. Translate business requirements into technical architectures, defining standards for LLM integration and generative AI workflows.
- Hybrid
- Toronto, ON
- Posted Jul 24, 2026
- Apply by Jan 20, 2027
- 1 position
More jobs you can apply to directly
Similar opportunities posted by employers hiring on Jobs.ca, with no external application form.
Job summary
Senior AI / Software Architect Type: Contract · Term: 3 years · Level: Senior · Location: Canada (remote with occasional on-site) About the Role We are seeking a Senior AI / Software Architect to lead the design of AI, machine learning, and automation solutions for enterprise and public-sector clients. You will translate business needs into scalable, secure, cloud-based AI architectures, define standards for LLM and generative-AI integration, and guide teams delivering innovation and automation initiatives. This is a strategy-and-design leadership role with hands-on architecture ownership. Key Responsibilities Analyze business processes, data sources, and initiative proposals to identify AI, ML, generative-AI, and automation opportunities. Translate business requirements into AI/ML/LLM solution designs — model selection, data needs, integration points, and security considerations. Design scalable, cloud-based AI architectures across Azure and/or AWS environments (logical and physical). Define architectural patterns for LLM integration, including Retrieval-Augmented Generation (RAG), agent-based workflows, and API integration with existing applications. Develop target-state AI platform architecture, standards, and reusable components for consistency, scalability, and reuse. Produce AI use-case assessments and recommendations tailored to client requirements. Develop feasibility and risk assessments for AI/automation adoption, including sandboxing strategies and progressive assurance models. Embed data governance, classification, privacy, and cyber-security controls into AI solution designs. Collaborate with business, IT, data, security, enterprise-architecture, and operations stakeholders to validate designs and resolve integration issues. Produce architecture diagrams, technical documentation, and operational runbooks; support knowledge transfer to client staff. Required Qualifications & Experience Senior-level experience (typically 8+ years) architecting software solutions, with recent focus on AI/ML/LLM/automation. Demonstrated experience designing end-to-end AI solution architecture — both logical and physical. Hands-on experience with LLM and generative-AI strategy and design: RAG, agentic patterns, and integration approaches. Experience providing technical direction to teams working with Microsoft Power Platform, Azure AI/ML or Azure AI Studio, AWS SageMaker, ChatGPT, and/or Cohere. Proven track record developing AI/LLM/ML/RPA use cases and moving concepts from proof-of-concept to production. Experience working in complex, governed environments with data classification regimes, privacy and cyber-security protocols, and formal tool-use approvals (e.g., cyber-security group or data-governance committee sign-off). Technology & Skills Cloud AI: Azure AI/ML, Azure AI Studio, AWS SageMaker LLM/GenAI: RAG architectures, agent frameworks, prompt/API integration, ChatGPT, Cohere Automation: Power Platform, RPA/IPA concepts, ML pipelines Architecture: solution & enterprise architecture, API design, secure integration, cloud infrastructure patterns Governance: Responsible AI, data governance/classification, privacy and security-by-design Nice to Have Public-sector or Government of Canada delivery experience. Familiarity with GC responsible-AI principles and accessibility standards (EN 301 549). Relevant cloud/AI certifications (Azure, AWS).
What you’ll do
Lead the design of scalable, secure, cloud-based AI and automation solutions for enterprise and public-sector clients. Translate business requirements into technical architectures, defining standards for LLM integration and generative AI workflows.
Requirements
Requires over 8 years of experience in software architecture with a recent focus on AI/ML and generative AI patterns like RAG. Must have a proven track record of moving AI concepts from proof-of-concept to production within complex, governed environments.
Other relevant skills
Identified from the job description. Confirm important requirements above.
- AI Architecture
- Machine Learning
- Generative AI
- LLM Integration
- RAG
- Azure AI/ML
- AWS SageMaker
- Power Platform
- Solution Architecture
- Enterprise Architecture
- Data Governance
- Cyber-security
- API Design
- RPA
- Cloud Infrastructure
- Prompt Engineering
Job areas
- Software
- Technology
- Data & Analytics
- Consulting
- Government & Public Sector
Additional details
- Minimum experience
- 10+ years
- Apply by
- Jan 20, 2027
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Mid-Senior level
- Application method
- Direct apply is available
