Top Benefits
About the role
Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.
Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In August, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services.
About the Role
You will develop high-performance code running the distributed system consisting of the CS-2 and multiple heterogenous servers. Feeding model and training data to the CS-2 in the Weight Streaming regime, as well as CPU-side processing of this data, is a huge challenge that requires optimized data structures and algorithms that take full advantage of the available hardware resources, including CPU, memory, storage, and network bandwidth.
The software must be built with a high degree of concurrency across threads, processes, cores, and systems. It is central to the Cerebras Weight Streaming architecture which scales to brain-sized neural networks with over 100T parameters.
Skills And Qualifications
- Experienced engineer with 3+ years of experience.
- Strong low-level programming: C/C++, multi-threading, performance optimization, exposure to Assembly-level programming.
- Assets: Knowledge of basic compiler internals, experience with distributed systems and protocol design, Python knowledge (especially in ML contexts).
- Track record of working on large, complex system software.
- Prior projects where custom HW is given, write SW to unlock potential of HW.
Why Join Cerebras
People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:
-
Build a breakthrough AI platform beyond the constraints of the GPU.
-
Publish and open source their cutting-edge AI research.
-
Work on one of the fastest AI supercomputers in the world.
-
Enjoy job stability with startup vitality.
-
Our simple, non-corporate work culture that respects individual beliefs.
About Cerebras Systems
Cerebras Systems is a team of pioneering computer architects, computer scientists, deep learning researchers, functional business experts and engineers of all types. We have come together to build a new class of computer to accelerate artificial intelligence work by three orders of magnitude beyond the current state of the art.
The CS-3 is the fastest AI computer in existence. It contains a collection of industry firsts, including the Cerebras Wafer Scale Engine (WSE-3). The WSE-3 is the largest chip ever built. It contains 4 trillion transistors and covers more than 46,225 square millimeters of silicon. In artificial intelligence work, large chips process information more quickly producing answers in less time. As a result, models that in the past took months to train, can now train in minutes on the Cerebras CS-3 powered by the WSE-3. Additionally, Cerebras accelerates inference of large models, enabling instant results.
Join us: https://cerebras.net/careers/
Top Benefits
About the role
Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.
Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In August, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services.
About the Role
You will develop high-performance code running the distributed system consisting of the CS-2 and multiple heterogenous servers. Feeding model and training data to the CS-2 in the Weight Streaming regime, as well as CPU-side processing of this data, is a huge challenge that requires optimized data structures and algorithms that take full advantage of the available hardware resources, including CPU, memory, storage, and network bandwidth.
The software must be built with a high degree of concurrency across threads, processes, cores, and systems. It is central to the Cerebras Weight Streaming architecture which scales to brain-sized neural networks with over 100T parameters.
Skills And Qualifications
- Experienced engineer with 3+ years of experience.
- Strong low-level programming: C/C++, multi-threading, performance optimization, exposure to Assembly-level programming.
- Assets: Knowledge of basic compiler internals, experience with distributed systems and protocol design, Python knowledge (especially in ML contexts).
- Track record of working on large, complex system software.
- Prior projects where custom HW is given, write SW to unlock potential of HW.
Why Join Cerebras
People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:
-
Build a breakthrough AI platform beyond the constraints of the GPU.
-
Publish and open source their cutting-edge AI research.
-
Work on one of the fastest AI supercomputers in the world.
-
Enjoy job stability with startup vitality.
-
Our simple, non-corporate work culture that respects individual beliefs.
About Cerebras Systems
Cerebras Systems is a team of pioneering computer architects, computer scientists, deep learning researchers, functional business experts and engineers of all types. We have come together to build a new class of computer to accelerate artificial intelligence work by three orders of magnitude beyond the current state of the art.
The CS-3 is the fastest AI computer in existence. It contains a collection of industry firsts, including the Cerebras Wafer Scale Engine (WSE-3). The WSE-3 is the largest chip ever built. It contains 4 trillion transistors and covers more than 46,225 square millimeters of silicon. In artificial intelligence work, large chips process information more quickly producing answers in less time. As a result, models that in the past took months to train, can now train in minutes on the Cerebras CS-3 powered by the WSE-3. Additionally, Cerebras accelerates inference of large models, enabling instant results.
Join us: https://cerebras.net/careers/