Jobs.ca
Jobs.ca
Language
Amplify.LA logo

Senior Performance Engineer - LLM Inference Optimization

Amplify.LAabout 22 hours ago
Hybrid
Montreal, Quebec, Canada
Senior Level
Full-Time

Top Benefits

Founding-Engineer Equity
Access to State-of-the-Art Compute Resources
Remote-Friendly

About the role

Our Company Description

Mission is a platform for hiring, vetting and managing software development talents. It enables our clients to connect with the world’s best talent to build mission-critical software products.

About The Company

This company provides an open-source, collaborative data platform and headless backend that connects to any SQL database. It offers instant REST and GraphQL APIs alongside a no-code interface for data and content management. The platform is designed to be unopinionated, supporting diverse technology stacks while allowing organizations to maintain full control over their data schemas. It features modular architecture and integrated automation tools to streamline digital asset management and backend development.

About The Company

An early-stage AI infrastructure startup specializing in inference optimization. The company develops software to increase compute performance per watt on GPUs, integrating with major serving stacks to provide kernel-level power telemetry. By utilizing a proprietary optimization engine and runtime controller, the platform helps AI teams maintain high throughput under power constraints, dynamically adjusting performance as models and hardware conditions evolve.

About The Role

As a Senior Performance Engineer and founding team member, you will architect solutions across the entire inference stack. You will have direct ownership over optimizing kernels, shaping the serving engine, and improving orchestration to redefine large-scale model deployment. Your work will directly impact the cost and energy efficiency of AI at scale, pushing GPU utilization toward theoretical limits. This role offers the opportunity to translate complex research into robust, production-ready systems that influence the future of high-performance computing.

What You'll Do

Design and build high-performance inference systems for large-scale models across multi-GPU and multi-node deployments. Develop custom kernels and runtime paths to maximize GPU utilization and memory efficiency. Extend serving engines by implementing advanced batching, KV-cache management, and scheduling policies. Architect distributed inference systems including autoscaling, load balancing, and failure handling under strict latency SLOs. Profile and analyze the full inference lifecycle to identify and resolve systemic bottlenecks. Implement advanced techniques such as speculative decoding, tensor parallelism, and mixture-of-experts serving. Collaborate with hardware partners to co-design software strategies that improve energy efficiency and reduce operational costs. Contribute to internal tooling and relevant open-source projects within the inference ecosystem.

What You Bring

Extensive experience building or operating large-scale production inference or training systems. Deep understanding of GPU architectures, including compute, memory bandwidth, and kernel launch characteristics. Proficiency with the modern inference ecosystem and frameworks. Strong foundation in systems and distributed systems, including concurrency, scheduling, and fault tolerance. Expertise in debugging performance issues across layers, from kernel traces to autoscaler dynamics. Ability to own technical problems end-to-end, from initial measurement to long-term operational health.

Nice to Haves

Contributions to major open-source inference frameworks or libraries. Experience with Kubernetes-based infrastructure and modern observability stacks. Knowledge of energy-aware scheduling or capacity planning for large accelerator fleets. Familiarity with post-training pipelines and their interaction with inference infrastructure.

Compensation & Benefits

Founding-engineer equity and direct ownership. Access to state-of-the-art compute resources and hardware. Remote-friendly. Montreal preferred for regular in-person work with the founding team.

About Amplify.LA

Venture Capital and Private Equity Principals
11-50 employees
Founded in 2011

Amplify is an early stage venture capital firm in Venice, CA dedicated to making early investments in LA's most promising startups, and is a leading institution in the Los Angeles venture capital scene.

Since 2011, Amplify has backed dozens of companies, which together have gone on to raise billions of dollars in funding, with exits to Apple, Google, and FanDuel, among others.

Some prominent Amplify portfolio companies include:

  • Clutter (clutter.com)
  • FloQast (floqast.com)
  • HelloTech (hellotech.com)
  • Bouqs (bouqs.com)
  • Bitium (acquired by Google)
  • Winc (winc.com)

Similar Jobs