About the role
Join a dynamic project supporting a leading European AI company in building and maintaining advanced large language model (LLM) inference platforms for enterprise and government clients. This role focuses on ensuring the reliability, scalability, and performance of LLM inference services, with a strong emphasis on Kubernetes-based orchestration and modern cloud infrastructure. You will collaborate with cross-functional teams to integrate, operate, and optimize LLM inference APIs, playing a key part in the delivery of robust AI solutions at scale.
Responsibilities
- Lead the integration and orchestration of LLM inference APIs within production environments
- Manage and optimize Kubernetes clusters, Helm charts, and ArgoCD pipelines for AI workloads
- Ensure high availability, reliability, and performance of inference services across multiple deployments
- Collaborate with backend, platform, and infrastructure teams to deliver seamless AI platform operations
- Implement and maintain observability, monitoring, and alerting solutions for production systems
- Drive continuous improvement in CI/CD processes and cloud infrastructure for AI applications
- Troubleshoot and resolve issues related to LLM inference, scaling, and platform reliability
Skills And Requirements
- Proven experience with Kubernetes, Helm, and ArgoCD in production environments
- Strong proficiency in Python for automation, scripting, and API integration
- Solid understanding of LLM fundamentals, inference APIs, and generative AI platforms
- Hands-on experience with cloud infrastructure (AWS, GCP, or Azure) and CI/CD pipelines
- Familiarity with observability tools (e.g., Prometheus, Grafana, ELK stack) for monitoring and alerting
- Ability to work independently and collaboratively in a distributed, fast-paced team
- Excellent problem-solving skills and attention to detail
- Strong communication skills in English
- Availability for a full-time contract position
About Twine Twine is a leading freelance marketplace connecting top freelancers, consultants, and contractors with companies needing creative and tech expertise. Trusted by Fortune 500 companies and innovative startups alike, Twine enables companies to scale their teams globally.
Our Mission Twine's mission is to empower creators and businesses to thrive in an AI-driven, freelance-first world.
About Twine
Twine connects companies to over 750,000 freelance experts across 190+ countries. We enable flexible work opportunities for so many talented people. Twine covers tech, creative and AI – Software development, graphic design, animation, marketing, video products and everything in between.
STARTUPS (www.twine.net) Companies need a flexible and global workforce to keep competitive. However, they struggle to find specific experts to match their needs. If you have niche technical/creative requirements or need a freelancer in a specific location – we can help you.
FREELANCERS and CONSULTANTS (www.twine.net/freelancers) If you're a freelancer or consultant, take control and choose which projects you want to work on. Build your portfolio with Twine and find interesting jobs from all over the world.
AI COMPANIES (www.twine.net/ai) If you're a company that uses machine learning and needs audio-visual datasets, we can use our network of diverse freelancers to build this for you. Text to speech, video, actors, presenters, and more.
Similar jobs you might like
About the role
Join a dynamic project supporting a leading European AI company in building and maintaining advanced large language model (LLM) inference platforms for enterprise and government clients. This role focuses on ensuring the reliability, scalability, and performance of LLM inference services, with a strong emphasis on Kubernetes-based orchestration and modern cloud infrastructure. You will collaborate with cross-functional teams to integrate, operate, and optimize LLM inference APIs, playing a key part in the delivery of robust AI solutions at scale.
Responsibilities
- Lead the integration and orchestration of LLM inference APIs within production environments
- Manage and optimize Kubernetes clusters, Helm charts, and ArgoCD pipelines for AI workloads
- Ensure high availability, reliability, and performance of inference services across multiple deployments
- Collaborate with backend, platform, and infrastructure teams to deliver seamless AI platform operations
- Implement and maintain observability, monitoring, and alerting solutions for production systems
- Drive continuous improvement in CI/CD processes and cloud infrastructure for AI applications
- Troubleshoot and resolve issues related to LLM inference, scaling, and platform reliability
Skills And Requirements
- Proven experience with Kubernetes, Helm, and ArgoCD in production environments
- Strong proficiency in Python for automation, scripting, and API integration
- Solid understanding of LLM fundamentals, inference APIs, and generative AI platforms
- Hands-on experience with cloud infrastructure (AWS, GCP, or Azure) and CI/CD pipelines
- Familiarity with observability tools (e.g., Prometheus, Grafana, ELK stack) for monitoring and alerting
- Ability to work independently and collaboratively in a distributed, fast-paced team
- Excellent problem-solving skills and attention to detail
- Strong communication skills in English
- Availability for a full-time contract position
About Twine Twine is a leading freelance marketplace connecting top freelancers, consultants, and contractors with companies needing creative and tech expertise. Trusted by Fortune 500 companies and innovative startups alike, Twine enables companies to scale their teams globally.
Our Mission Twine's mission is to empower creators and businesses to thrive in an AI-driven, freelance-first world.
About Twine
Twine connects companies to over 750,000 freelance experts across 190+ countries. We enable flexible work opportunities for so many talented people. Twine covers tech, creative and AI – Software development, graphic design, animation, marketing, video products and everything in between.
STARTUPS (www.twine.net) Companies need a flexible and global workforce to keep competitive. However, they struggle to find specific experts to match their needs. If you have niche technical/creative requirements or need a freelancer in a specific location – we can help you.
FREELANCERS and CONSULTANTS (www.twine.net/freelancers) If you're a freelancer or consultant, take control and choose which projects you want to work on. Build your portfolio with Twine and find interesting jobs from all over the world.
AI COMPANIES (www.twine.net/ai) If you're a company that uses machine learning and needs audio-visual datasets, we can use our network of diverse freelancers to build this for you. Text to speech, video, actors, presenters, and more.