Software Development Engineer II

Job summary

You will design and build AI agents, including the reasoning, orchestration, and data retrieval layers. You will own the performance of these agents in production, focusing on latency, accuracy, and cost efficiency.

Job details

Do you want to build AI agents that help customers make sense of their data? We're applying large language models and agentic systems to a real, high-scale problem — turning large volumes of signals into fast, accurate responses customers can act on — and we're looking for engineers who want to shape it from the ground up. We're looking for a software engineer to join the team to design and build the agent end to end — the reasoning and orchestration layer, the tools and skills it uses to retrieve and analyze data, the quality of the answers it produces, and the experience of interacting with it. This is applied GenAI on real, high-scale data: you'll work with large language models, agentic orchestration, and the retrieval systems that feed them. Because our customers depend on fast, correct responses, you'll own the qualities that make an agent great in production — response latency, accuracy, and cost. As an SDE II you'll own features and components of the agent — designing and delivering capabilities, tools, and skills, contributing to design reviews, and raising the bar on latency, accuracy, and cost within your area. We work in some of the most exciting problem spaces in software today: LLM-based agents, large-scale data retrieval and streaming systems, and the analytics pipelines that turn high volumes of data into answers. If you're passionate about building AI systems that solve real business problems, and you want a team whose results directly influence Amazon's business, this is the right place for you. The ideal candidate is innovative with strong problem-solving, analytical, and technical skills. You're comfortable and confident on Linux systems, have a deep understanding of software development in an agile team, and enjoy simplifying complex problems and tackling challenges. You demonstrate exceptional customer focus and love discovering the true requirements underlying a feature request. Basic Qualifications: - 3+ years of non-internship professional software development experience - 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience - Experience programming with at least one software programming language Preferred Qualifications: - 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience - Bachelor's degree in computer science or equivalent Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations [https://amazon.jobs/content/en/how-we-hire/accommodations] for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner. The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status. CAN, ON, Toronto - 114,800.00 - 191,800.00 CAD annually

What you’ll do

You will design and build AI agents, including the reasoning, orchestration, and data retrieval layers. You will own the performance of these agents in production, focusing on latency, accuracy, and cost efficiency.

Requirements

Candidates must have at least 3 years of professional software development experience and 2 years of system design or architecture experience. Proficiency in at least one programming language and comfort with Linux systems are required.

Benefits

• Health insurance
• Medical insurance
• Dental insurance
• Vision insurance
• Prescription insurance
• Basic life insurance
• AD&D insurance
• Registered retirement savings plan
• Deferred profit sharing plan
• Paid time off
• Restricted stock units

Listed skills

• Problem solving · Preferred
• Accuracy · Preferred
• Agile · Preferred
• Linux · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Software development
• Large language models
• Agentic systems
• Data retrieval
• System design
• Architecture
• Linux
• Agile
• Latency optimization
• Accuracy
• Cost management
• Analytics pipelines
• Streaming systems
• Problem solving
• Analytical skills
• Influencing Skills
• Large Language Modeling
• Business Problems
• Generative Artificial Intelligence
• Agentic Systems
• Time Off Management
• AI Agents
• Agile Methodology
• Software Development
• Architectural Design
• Building Codes
• Customer Service
• Version Control
• Code Review
• Computer Science
• Data Retrieval
• Software Development Life Cycle
• Innovation
• Problem Solving
• Medical Prescription
• Operations
• Restricted Stock
• Software Engineering
• Artificial Intelligence Infrastructure

Job areas

• Software
• Technology
• Data & Analytics
• Engineering
• Software Development Engineer
• Software Developer / Engineer
• Software Developers

More jobs from Amazon