AI Automation Engineer

Job summary

Provide human feedback to train generative AI systems to plan, coordinate, and operate as proactive, multi-step agents. Evaluate complex agent behavior, test integrations with live tools and APIs, and identify failure modes and interaction risks.

Job details

Salary: $90,000 - 130,000 per year Requirements: We seek candidates with 2 or more years of experience in backend engineering, AI automation, or integrating complex systems. We expect a proven track record of building and supporting production-ready software with clear modular architecture, such as separate services for parsing, logic, and reporting. We require strong proficiency in at least two major programming languages, such as Python, JavaScript, Go, or Java, along with experience using SQL databases. We value practical experience developing for live, real-world environments and managing multi-turn system interactions. We look for exceptional attention to detail and the ability to deliver precise, high-signal technical feedback on intricate system behavior. We prefer experience designing multi-stage coordination workflows where data gathering leads to thoughtful, reasoned output. We value hands-on experience connecting agents to live tools such as Supabase, Gmail, and other APIs to solve operational problems. We appreciate comfort with persistent state and session tracking using MEMORY.md to monitor agent progress. We favor candidates who can identify subtle issues such as privacy leakage, authority escalation, or indirect prompt injection. Responsibilities: We train advanced generative systems by providing human feedback that helps improve AI agents. We help large language models learn to operate as proactive, multi-step agents. We contribute to teaching systems how to plan, coordinate, and refine complex real-world architectural workflows. We support the development of orchestration capabilities for autonomous agents. We evaluate and provide detailed feedback on complex system behavior. We work on tasks that involve multi-stage reasoning, data collection, and structured output. We may test agent integrations with live tools and APIs in realistic environments. We help surface subtle failure modes and interaction risks in agentic systems. Technologies: AI Backend Support Java JavaScript Python SQL More We are Outlier, and we help innovative companies improve their AI agents through human feedback. Our work centers on training large language models to become proactive, multi-step agents capable of handling real-world architectural workflows. We partner with leading AI organizations on advanced generative system training, and we welcome both orchestration specialists and experienced software developers who want to shape the future of autonomous agents like OpenClaw. last updated 40 week of 2026

What you’ll do

Provide human feedback to train generative AI systems to plan, coordinate, and operate as proactive, multi-step agents. Evaluate complex agent behavior, test integrations with live tools and APIs, and identify failure modes and interaction risks.

Requirements

Candidates need at least two years of experience in backend engineering, AI automation, or complex system integration, with a record of building and supporting production-ready software. They should be proficient in at least two major programming languages, have SQL experience, and be able to assess multi-stage workflows, live tool integrations, and risks such as privacy leakage or prompt injection.

Listed skills

• Python · Preferred
• JavaScript · Preferred
• Go · Preferred
• Java · Preferred
• SQL · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Backend Engineering
• AI Automation
• System Integration
• Python
• JavaScript
• Go
• Java
• SQL
• Modular Architecture
• Multi-Turn System Interactions
• Workflow Orchestration
• API Integration
• Agent Development
• Session Tracking
• Prompt Injection Detection
• Technical Evaluation

Job areas

• Technology
• Software
• Engineering
• Data & Analytics

More jobs from Outlier AI