Senior AI/LLM Engineer (Python) - Remote

Job summary

Design, build, and deploy Python-based LLM applications, backend APIs, and RAG pipelines, integrating model providers and optimizing for cost, latency, and quality. Develop evaluation tools and tests for AI output quality, safety, and regressions, while collaborating with stakeholders to deliver production-ready AI solutions.

Job details

Senior AI/LLM Engineer (Python) - Remote Kake is a remote-first company and a people-first global community of senior engineers. Kake engineers are behind some of the world’s most innovative products (Brands you’ve heard!), from Fortune 500 to fast-growing companies. We believe it’s not where your table is, but what you bring to the table that matters. Our community spans 45,000+ engineers across 55+ countries; join a culture where great people stay, grow, and thrive (and love eating kake!). Senior AI/LLM Engineers with strong Python experience, skilled in designing, building, and productionizing LLM-powered applications and AI systems at scale. It's a great fit for people who enjoy working at the intersection of software engineering and applied AI, and who take ownership from prototyping through production deployment. What you’ll build and own Design, build, and deploy LLM-powered features and applications using Python. Develop and maintain backend services and APIs (e.g., FastAPI) that expose AI/LLM capabilities to other systems. Build and optimize RAG pipelines, including embeddings, vector search, and retrieval strategies. Design, test, and iterate on prompts, agents, and orchestration flows using frameworks such as LangChain, LlamaIndex, or similar. Integrate with LLM providers and APIs (e.g., OpenAI, Anthropic, open-source models) and manage tradeoffs around cost, latency, and quality. Evaluate model outputs systematically, building tooling and metrics to test accuracy, safety, and regression across iterations. Work with containerized environments and data infrastructure (e.g., PostgreSQL, Redis, vector databases) to support reliable AI systems in production. Collaborate with cross-functional stakeholders to translate ambiguous product needs into technically sound AI solutions. Core Requirements Strong proficiency in Python and experience with FastAPI or similar backend frameworks. Experience working with LLM APIs (e.g., OpenAI, Anthropic, or similar) and frameworks such as LangChain or LlamaIndex. Experience with RAG architectures, embeddings, and vector databases (e.g., Pinecone, Weaviate, pgvector, or similar). Hands-on experience with Docker and containerized development environments. Experience working with PostgreSQL, Redis, or similar data stores. Strong experience writing functional and integration tests, including evaluation frameworks for AI/LLM output quality. Excellent written and verbal communication skills in English. Ability to work independently in a remote, fast-paced environment. Nice-to-Have Experience fine-tuning or evaluating open-source LLMs. Familiarity with prompt engineering best practices and agentic workflows. Experience with distributed systems, streaming (e.g., Kafka), or large-scale applications. Background in machine learning fundamentals (e.g., scikit-learn, PyTorch, or TensorFlow). Comfortable working flexible hours to overlap with distributed teams across different time zones. Why Join Kake? The icing on the Kake: 💰 Competitive Pay in USD: Work globally, get paid globally. 🌎 Fully Remote: Simply put, we trust you. 💜 Better Me Fund: We invest in your personal growth and passions. 🎂 Compassion is Badass: Join a community that invests in social good. Ready for your piece of the Kake? Apply now! Quick note: Due to the high volume of applications, only shortlisted candidates will be contacted.

What you’ll do

Design, build, and deploy Python-based LLM applications, backend APIs, and RAG pipelines, integrating model providers and optimizing for cost, latency, and quality. Develop evaluation tools and tests for AI output quality, safety, and regressions, while collaborating with stakeholders to deliver production-ready AI solutions.

Requirements

Requires strong Python and backend framework experience, hands-on work with LLM APIs and orchestration frameworks, and familiarity with RAG, embeddings, vector databases, Docker, and data stores such as PostgreSQL or Redis. Candidates should have experience testing software and evaluating LLM outputs, communicate effectively in English, and work independently in a remote environment.

Benefits

• Competitive Pay in USD
• Fully Remote
• Personal Growth Fund
• Social Good Initiatives

Listed skills

• Redis · Preferred
• PostgreSQL · Preferred
• Docker · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Python
• FastAPI
• Large Language Models
• OpenAI API
• Anthropic API
• LangChain
• LlamaIndex
• Retrieval-Augmented Generation
• Embeddings
• Vector Databases
• Docker
• PostgreSQL
• Redis
• Functional Testing
• Integration Testing
• AI Evaluation Frameworks

Job areas

• Software
• Technology
• Engineering
• Data & Analytics

More jobs from Kake