Backend Engineer, AI (Agent Systems)

Job summary

The Backend Engineer will design, build, and maintain scalable infrastructure and inference pipelines to support AI-powered applications. They are responsible for ensuring system reliability, optimizing performance, and collaborating with cross-functional teams to deploy AI-driven features.

Job details

We're looking for a remote Backend Engineer, AI Agent Systems in the artificial intelligence and software technology industry. Our client is building the next generation of AI-native productivity tools designed to help people accomplish more with less effort. Their mission is to create a proactive smart assistant that brings intelligence to conversations, organization, workflows, and everyday tasks. Unlike traditional applications, their platform is designed around AI from the ground up, delivering reliable, long-running workflows, persistent context, and real-world task completion. This is an opportunity to join a high-performing team focused on solving complex technical challenges at the forefront of AI. The Backend Engineer, AI Agent Systems will be responsible for building and operating the infrastructure that powers intelligent AI interactions, ensuring fast, reliable, and scalable experiences for users worldwide. Backend Engineer, AI Agent Systems responsibilities: Design, build, and maintain backend services supporting AI-powered applications in production environments Develop inference pipelines, orchestration frameworks, and service architectures that connect AI models with end-user applications Build and support scalable APIs used across web, mobile, and desktop platforms Monitor production systems and own operational excellence, including logging, alerting, observability, and incident response Optimize performance across AI inference workflows through caching, batching, streaming, and throughput improvements Collaborate with machine learning engineers and product teams to deploy and scale AI-driven features Troubleshoot and resolve issues within distributed systems operating under high traffic and demanding performance requirements Continuously improve reliability, latency, scalability, and cost efficiency of backend services Contribute to architectural decisions and best practices for cloud-native application development Support the delivery of innovative AI capabilities through rapid iteration and continuous learning from production environments The successful candidate has: 3+ years of backend software engineering experience in production environments Post-secondary education in Computer Science, Software Engineering, or a related technical discipline Strong programming experience with Python and/or Node.js Experience designing and operating high-throughput, low-latency distributed systems Familiarity with AI technologies including large language models (LLMs), embeddings, inference systems, and multimodal applications Experience with SQL and NoSQL database technologies Working knowledge of Kubernetes, Docker, and modern cloud-native development practices Strong debugging and problem-solving skills within complex distributed architectures Experience building, monitoring, and supporting production-grade APIs and backend services Ability to work independently in a fast-paced, collaborative environment with a strong bias toward execution and continuous improvement Compensation and benefits: The discussed salary range is $140,000 - $190,000, depending on experience Candidates with additional experience and higher compensation expectations may also be considered Fully remote work environment Opportunity to work on cutting-edge AI and agent-based systems Exposure to industry-leading technologies including OpenAI, Anthropic, PyTorch, Kubernetes, and large-scale distributed systems Career growth within a high-talent-density engineering team Flexible and entrepreneurial culture focused on innovation and impact Candidates must be legally authorized to work in Canada. Only candidates selected to move forward in the hiring process will be contacted. #IND

What you’ll do

The Backend Engineer will design, build, and maintain scalable infrastructure and inference pipelines to support AI-powered applications. They are responsible for ensuring system reliability, optimizing performance, and collaborating with cross-functional teams to deploy AI-driven features.

Requirements

Candidates must have at least 3 years of backend software engineering experience in production environments and strong proficiency in Python or Node.js. A post-secondary degree in a technical discipline and experience with distributed systems and cloud-native technologies are required.

Benefits

• Fully remote work environment • Career growth opportunities • Flexible culture

Listed skills

• Kubernetes · Preferred
• SQL · Preferred
• Node.js · Preferred
• Docker · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Python
• Node.js
• Distributed systems
• SQL
• NoSQL
• Kubernetes
• Docker
• LLMs
• Embeddings
• Inference systems
• API development
• Observability
• Cloud-native development
• Debugging
• Performance optimization

Job areas

• Software
• Technology
• Engineering
• Data & Analytics