Intern Researcher - LLM Optimization Algorithms
About the role
Huawei Canada has an immediate internship opening for a Researcher. About the team: Founded in 2012, the Noah’s Ark lab has evolved into a prominent research organization with notable achievements in academia and industry. The lab’s mission focuses on advancing artificial intelligence and related fields to benefit the company and society. Driven by impactful, long-term projects, the aim is to enhance state-of-the-art research while integrating innovations into the company's products and services, including LLMs, RL, NLP, computer vision, AI theory, and Autonomous driving.
About the job:
- Development and implementation of new optimization algorithms for training LLMs.
- Conducting large-scale experiments to validate and evaluate proposed algorithms versus the current SOTA.
- Present results and write scientific papers for top AI/ML conferences.
Job requirements
About the ideal candidate:
- Currently a PhD or Master's student in computer science or related fields, with an emphasis on optimization algorithms and training LLMs.
- Knowledge of current LLM architectures, such as Transformer and Mamba.
- Deep understanding of the fundamentals and state-of-the-art techniques of numerical optimization, as currently being applied to deep learning models (e.g., non-convex optimization theory, SGD, AdamW).
- Strong hands-on programming skills with experience in implementing and customizing optimization algorithms for deep learning models using libraries such as PyTorch.
- First-author publication in top-tier ML conferences or journals, such as NeurIPS, ICML, ICLR, JMLR, etc., is a plus.
About Huawei Canada
Founded in 1987, Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices. We are committed to bringing digital to every person, home and organization for a fully connected, intelligent world. We have approximately 197,000 employees and we operate in over 170 countries and regions, serving more than three billion people around the world.
In Canada, Huawei conducts innovative and leading edge research in 5G technologies, along with advanced development of emerging cloud, device and network technologies & services. While our renowned Canada Research Centre in the thriving technology landscape of Ottawa, Ontario continues to grow rapidly in size and strategic product initiatives, additional presence has also been established across Canada with R&D facilities in Vancouver, Edmonton, Waterloo, Markham, Montreal, and a R&D office in Quebec City.
Intern Researcher - LLM Optimization Algorithms
About the role
Huawei Canada has an immediate internship opening for a Researcher. About the team: Founded in 2012, the Noah’s Ark lab has evolved into a prominent research organization with notable achievements in academia and industry. The lab’s mission focuses on advancing artificial intelligence and related fields to benefit the company and society. Driven by impactful, long-term projects, the aim is to enhance state-of-the-art research while integrating innovations into the company's products and services, including LLMs, RL, NLP, computer vision, AI theory, and Autonomous driving.
About the job:
- Development and implementation of new optimization algorithms for training LLMs.
- Conducting large-scale experiments to validate and evaluate proposed algorithms versus the current SOTA.
- Present results and write scientific papers for top AI/ML conferences.
Job requirements
About the ideal candidate:
- Currently a PhD or Master's student in computer science or related fields, with an emphasis on optimization algorithms and training LLMs.
- Knowledge of current LLM architectures, such as Transformer and Mamba.
- Deep understanding of the fundamentals and state-of-the-art techniques of numerical optimization, as currently being applied to deep learning models (e.g., non-convex optimization theory, SGD, AdamW).
- Strong hands-on programming skills with experience in implementing and customizing optimization algorithms for deep learning models using libraries such as PyTorch.
- First-author publication in top-tier ML conferences or journals, such as NeurIPS, ICML, ICLR, JMLR, etc., is a plus.
About Huawei Canada
Founded in 1987, Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices. We are committed to bringing digital to every person, home and organization for a fully connected, intelligent world. We have approximately 197,000 employees and we operate in over 170 countries and regions, serving more than three billion people around the world.
In Canada, Huawei conducts innovative and leading edge research in 5G technologies, along with advanced development of emerging cloud, device and network technologies & services. While our renowned Canada Research Centre in the thriving technology landscape of Ottawa, Ontario continues to grow rapidly in size and strategic product initiatives, additional presence has also been established across Canada with R&D facilities in Vancouver, Edmonton, Waterloo, Markham, Montreal, and a R&D office in Quebec City.