About the role
AI/ML Solutions Architect – Distributed Training & GPU Infrastructure Location: Remote from anywhere in Canada Total compensation up to ~500k Canadian Dollars (base + variable), depending on level and experience.
Join a fast-moving AI infrastructure team working on the cutting edge of large-scale ML workloads. This role is ideal for engineers who enjoy solving deep technical challenges in distributed training, multi-GPU systems, and scalable AI inference infrastructure. You will work directly with AI-focused clients, helping them get the most out of modern GPUs (H100, B200, etc.) and ML frameworks such as PyTorch (and JAX in some environments).
Team & Responsibilities Work alongside senior AI and infrastructure engineers building large-scale GPU platforms. As part of the customer solutions team, you will: Design and validate production-grade distributed training (primary) and large-scale inference architectures on large GPU clusters, typically tens to thousands of GPUs Work hands-on with customers to debug, optimize, and scale ML workloads across multi-node GPU environments Act as a technical authority on GPU performance, networking, and schedulers, making trade-offs at scale and translating customer needs into concrete platform requiremen tsCollaborate closely with engineering, product, and R&;D to influence roadmap decisions based on real-world ML workloads This is a hands-on, technical role; you are expected to work directly in customer environments, not only advise at a high level.
Required Skills Hands-on experience designing and operating production-grade, multi-node GPU workloads for training or inference Strong background in distributed deep learning (PyTorch Distributed, DeepSpeed) on GPU clusters Deep understanding of GPU architecture and interconnects (H100/A100 class, NVLink, InfiniBand) Experience with Kubernetes or Slurm and performance tuning using GPU profiling and monitoring tools
This role is not a fit if your experience is limited to single-node training, high-level AI strategy, or non-production research environments. We are looking for engineers and architects who thrive at the intersection of AI workloads and large-scale infrastructure. Interested? Apply!
Not the right fit? Search for AI/ML Solution Architect jobs in Canada
About Doghouse Recruitment
Recruitment for your technology teams.
You don't need another agency flooding your inbox with mismatched candidates. You need senior recruiters who understand tech, challenge your thinking, and deliver candidates you didn't know how to reach.
At Doghouse, we operate like a tech company: fast, direct, and driven by solving problems, not hitting KPIs. No junior handovers. No sugarcoated updates. Just structured delivery sprints that keep you informed and in control.
What we do:
Permanent hiring From medior engineers to principal-level specialists. We build high-performing product and engineering teams in roles that matter: engineering, data, DevOps, InfoSec. When we send someone, it's because they actually fit.
Executive search in tech: Managing Director, CTO, VP Engineering, Head of Product. Leadership hires that shape the direction of your company. We know what separates a good leader from the right one for your context.
Interim & freelance Mission-critical projects need top specialists, fast. We deliver experienced interim leaders and senior contractors who can hit the ground running. Most clients wish they'd called us sooner. We're not here to flood your inbox.
We're here to solve your hiring problem. Learn how we work at www.doghouse.nl
Similar Jobs
About the role
AI/ML Solutions Architect – Distributed Training & GPU Infrastructure Location: Remote from anywhere in Canada Total compensation up to ~500k Canadian Dollars (base + variable), depending on level and experience.
Join a fast-moving AI infrastructure team working on the cutting edge of large-scale ML workloads. This role is ideal for engineers who enjoy solving deep technical challenges in distributed training, multi-GPU systems, and scalable AI inference infrastructure. You will work directly with AI-focused clients, helping them get the most out of modern GPUs (H100, B200, etc.) and ML frameworks such as PyTorch (and JAX in some environments).
Team & Responsibilities Work alongside senior AI and infrastructure engineers building large-scale GPU platforms. As part of the customer solutions team, you will: Design and validate production-grade distributed training (primary) and large-scale inference architectures on large GPU clusters, typically tens to thousands of GPUs Work hands-on with customers to debug, optimize, and scale ML workloads across multi-node GPU environments Act as a technical authority on GPU performance, networking, and schedulers, making trade-offs at scale and translating customer needs into concrete platform requiremen tsCollaborate closely with engineering, product, and R&;D to influence roadmap decisions based on real-world ML workloads This is a hands-on, technical role; you are expected to work directly in customer environments, not only advise at a high level.
Required Skills Hands-on experience designing and operating production-grade, multi-node GPU workloads for training or inference Strong background in distributed deep learning (PyTorch Distributed, DeepSpeed) on GPU clusters Deep understanding of GPU architecture and interconnects (H100/A100 class, NVLink, InfiniBand) Experience with Kubernetes or Slurm and performance tuning using GPU profiling and monitoring tools
This role is not a fit if your experience is limited to single-node training, high-level AI strategy, or non-production research environments. We are looking for engineers and architects who thrive at the intersection of AI workloads and large-scale infrastructure. Interested? Apply!
Not the right fit? Search for AI/ML Solution Architect jobs in Canada
About Doghouse Recruitment
Recruitment for your technology teams.
You don't need another agency flooding your inbox with mismatched candidates. You need senior recruiters who understand tech, challenge your thinking, and deliver candidates you didn't know how to reach.
At Doghouse, we operate like a tech company: fast, direct, and driven by solving problems, not hitting KPIs. No junior handovers. No sugarcoated updates. Just structured delivery sprints that keep you informed and in control.
What we do:
Permanent hiring From medior engineers to principal-level specialists. We build high-performing product and engineering teams in roles that matter: engineering, data, DevOps, InfoSec. When we send someone, it's because they actually fit.
Executive search in tech: Managing Director, CTO, VP Engineering, Head of Product. Leadership hires that shape the direction of your company. We know what separates a good leader from the right one for your context.
Interim & freelance Mission-critical projects need top specialists, fast. We deliver experienced interim leaders and senior contractors who can hit the ground running. Most clients wish they'd called us sooner. We're not here to flood your inbox.
We're here to solve your hiring problem. Learn how we work at www.doghouse.nl