Senior Backend Developer – Machine Learning Platform

Job summary

You will contribute to the development, testing, and deployment of a scalable AI platform that supports millions of daily machine learning predictions. You will also collaborate with data engineers and applied scientists to integrate agentic applications into production environments.

Job details

BUILD THE BACKBONE OF AI AT SCALE Want to see your work power millions of machine learning predictions every day? Join our Machine Learning Platform team and help bring models, including Large Language Models (LLMs), into production in a reliable and scalable way. You’ll contribute to a platform that trains thousands of models and serves hundreds of millions of queries daily, while growing your expertise in distributed systems and machine learning infrastructure. AS A SENIOR BACKEND DEVELOPER, YOU WILL: * Contribute to the development lifecycle, including coding, testing, and deployment * Analyze and help improve the ease of use, observability and reliability of our AI platform * Participate in maintaining services handling millions of requests and LLM calls per day * Collaborate with applied scientists, data engineers, and developers to integrate ML models and agentic applications into production * Contribute to evolving our AI platform to support the growth and scale of ML models and agentic workflows for Coveo users * Suggest improvements to existing processes and use AI coding tools to support your development workflow HERE IS WHAT WILL QUALIFY YOU FOR THE ROLE: * 5+ years of experience in backend development in a cloud environment (Java/Spring or Python preferred, AWS an asset) * Good understanding of distributed systems and scalable application design * Ability to solve problems and debug systems * Comfortable learning new tools, technologies, and best practices WHAT WILL MAKE YOU STAND OUT: * Familiarity with Kubernetes, Terraform, OpenSearch serverless or other vector databases * Exposure to machine learning workflows or model deployment * Interest in scalable backend services, large-scale realtime systems, model orchestration or realtime inference at scale Do you think you can bring this role to life? Or add your own color? You don’t need to check every single box; passion goes a long way and we appreciate that skillsets are transferable. Send us your application, we want to hear from you! Join the Coveolife! We encourage all qualified candidates to apply regardless of, for example, age, gender, disability, gaps in CV, national or ethnic background. This job description was written by humans, assisted by AI. We may leverage technology in our hiring process to help us see the person behind the resume. Coveo is committed to providing accessible employment practices. If you require accommodation due to a disability at any point during the recruitment process, please contact HR@Coveo.com to discuss your needs.

What you’ll do

You will contribute to the development, testing, and deployment of a scalable AI platform that supports millions of daily machine learning predictions. You will also collaborate with data engineers and applied scientists to integrate agentic applications into production environments.

Requirements

The role requires at least 5 years of backend development experience in a cloud environment, preferably with Python or Java. Candidates should possess a strong understanding of distributed systems and scalable application design.

Listed skills

• Machine learning · Preferred
• Amazon Web Services · Preferred
• Java · Preferred
• Terraform · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Backend Development
• Python
• Java
• Spring
• AWS
• Distributed Systems
• Machine Learning
• LLMs
• Terraform
• AWS Bedrock
• OpenSearch
• Vector Databases
• LiteLLM
• Agentic Workflows
• Scalable Application Design
• Observability
• Large Language Modeling
• Vector Database
• Back End (Software Engineering)
• Coveo
• Workflow Management
• Serverless Computing
• Artificial Intelligence
• Amazon Web Services
• Debugging
• Forecasting
• Scalability
• Spring Framework
• Python (Programming Language)
• Opensearch
• Machine Learning Infrastructure

Job areas

• Software
• Technology
• Data & Analytics
• Engineering
• Machine Learning Software Engineer
• Data Scientist
• Systems Analysts
• Data Scientists