B

Baseten

Verified Job Source

Own your inference.

San Francisco, CA

Software Development
201–500 people

About

Inference is everything. Baseten is an AI infrastructure platform giving you the tooling, expertise, and hardware needed to bring great AI products to market - fast. Our proprietary Inference Stack utilizes the cutting-edge of performance research combined with highly performant and reliable infrastructure to give you out-of-the-box global availability with 99.99% of uptime.

Open positions

AI Inference Engineer

On-site · Montréal

Partner with customers to architect, build, and deploy high-scale production AI applications on the Baseten platform. Own the end-to-end journey from initial exploration and PoC development to production deployment and monitoring.

Site Reliability Engineer

On-site · Montréal

As a Site Reliability Engineer, you will own the reliability of Baseten's multi-cloud Kubernetes infrastructure and build observability infrastructure. You will also identify failure patterns and create automated mitigations to enhance system reliability.

Cloud Platform Engineer

Remote · Montreal, Quebec, Canada

As a Cloud Platform Engineer, you will build and maintain scalable infrastructure to support the deployment and operation of machine learning models. You will also establish standards for reliability and performance while collaborating with cross-functional teams.

Forward Deployed Engineer

On-site · Montréal

As a Forward Deployed Engineer, you will partner with customers to architect, build, and deploy high-scale production AI applications. You will drive customer impact by designing and implementing Baseten solutions from initial exploration to production deployment.

Product Engineer - Dedicated Inference

On-site · Montréal

As a Product Engineer, you will implement new features and products, design APIs, and fix bugs for the Dedicated Inference team. You will work across the stack and collaborate with product and engineering teams to drive new product ideas.

Software Engineer - Voice AI (Inference Runtime)

Remote · Montreal, Quebec, Canada

Own and lead Voice AI product areas from architecture and system design through implementation and long-term production operations. Design and operate high-performance model serving systems for mission-critical customer deployments.

Software Engineer - Dedicated Inference

On-site · Montréal

Develop and maintain the developer experience for deploying AI workloads, including APIs, SDKs, and observability tools. Work across the full stack from React components to Kubernetes pods to implement new features and resolve customer issues.

Software Engineer - Billing and Internal Tooling

On-site · Montréal

As a Software Engineer, you will own Baseten’s billing and revenue infrastructure, ensuring a seamless customer experience. You will partner with various teams to create reliable internal tooling and drive operational excellence.

Software Engineer - Billing & Internal Tooling

On-site · Montréal

Own and evolve Baseten's end-to-end billing and revenue infrastructure, including pricing, invoicing, and metering. Partner with Finance and GTM teams to build reliable internal tooling and automation for revenue-critical workflows.

Software Engineer, Model Performance Systems

Remote · Montreal, Quebec, Canada

You will be responsible for building automated performance benchmarking tools and validating infrastructure for AI systems. This includes developing internal GPU-enabled environments and monitoring system health.

Security Engineer

On-site · Montréal

The Security Engineer will collaborate with engineering teams to design and implement secure systems while leading vulnerability assessments and incident response processes. They will also oversee identity and access management and ensure compliance with relevant security standards.

Solution Architect

On-site · Montréal

As a Solution Architect, you will partner with Sales and customers to translate business needs into technical solutions and guide deployments. You will lead demos, technical scoping, and manage POCs while collaborating closely with Sales and Engineering.

Software Engineer- BIS (Baseten Inference Stack)

Remote · Montreal, Quebec, Canada

Develop infrastructure and orchestration systems for deploying and managing large-scale distributed LLM inference. Collaborate closely with Model Performance engineers to improve the reliability, scalability, and usability of the inference stack.

Software Engineer - Baseten Inference Stack

On-site · Montréal

Develop and manage distributed infrastructure and orchestration systems for large-scale LLM inference. Build platform capabilities for routing, autoscaling, and observability while collaborating with performance engineers to optimize model deployment.

Software Engineer - Security

On-site · Montréal

The role involves designing and implementing secure cloud infrastructure and managing vulnerability assessments and incident response processes. Additionally, the engineer will oversee IAM strategies and ensure compliance with standards like SOC 2 and ISO 27001.

Solutions Architect

On-site · Montréal

Partner with Sales to translate business needs into technical AI solutions and lead technical discovery and demos. Own the execution of POCs, benchmarking, and repeatable deployment patterns for various AI modalities.

Software Engineer - Infrastructure

On-site · Montréal

As an Infrastructure Software Engineer, you will build and maintain components of the ML inference platform. You will contribute to core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance.

Software Engineer - Enterprise Platform

On-site · Montréal

Architect and develop infrastructure and platform features tailored for enterprise customers. Lead technical initiatives to productize secure and scalable private connectivity solutions.

Software Engineer - Model Performance

On-site · Montréal

Implement and productionize advanced techniques for ML model inference and infrastructure. Collaborate with a diverse team to optimize model performance and own projects from idea to production.