About the role
Job Requisition ID # 26WD94926
About The Role Join Autodesk’s AEC Design organization to help build, evaluate, and scale the next generation of AI-powered and agentic experiences and future MCP-based workflows!
You will work closely with senior Data Scientists, Software Engineers, and product teams to develop reliable ML models, evaluate LLM-driven tool calling, and contribute to unified LLM evaluation frameworks used across AEC. This role is ideal for an early-career engineer with strong ML fundamentals, curiosity for new AI technologies, and comfort working across both experimentation and engineering.
Responsibilities
- Develop and evaluate ML models (classification, regression, clustering, forecasting).
- Support LLM evaluation workflows, including dataset creation, metrics, and benchmarking for MCP and Assistant scenarios.
- Run offline batch evaluations and contribute to real-time evaluation instrumentation (Opik, Langfuse, custom pipelines).
- Collaborate with engineering teams to integrate models into production workflows with CI/CD best practices.
- Build scripts, utilities, and small pipelines to automate data preparation, experiments, and evaluation.
- Partner with PMs, domain experts, and cross-product teams to translate user scenarios into measurable evaluation tasks.
Minimum Qualifications
- Bachelor’s (2–3 years experience) or Master’s (new grad welcome) in CS, Data Science, Engineering, or similar.
- Strong Python skills and experience with ML fundamentals (feature engineering, training, validation).
- Familiarity with scikit-learn, pandas, NumPy; deep learning frameworks a plus.
- Experience with LLMs, prompt evaluation, or toolcalling workflows
- Understanding of CI/CD, git, and sound software engineering practices.
- Ability to analyze model quality using metrics, error analysis, and experiment tracking.
- Nice to have: experience with MCP, model evaluation frameworks, time-series data, cloud environments (AWS/Azure), Opik/Langfuse.
Why Autodesk?
- Work on cutting-edge ML and LLM technologies shaping the future of AEC design.
- Contribute to cross-product AI initiatives (Tyto, AA, MCP, Agentic Accelerator).
- Learn from and collaborate with experienced scientists, engineers, and product teams.
- Clear growth opportunities and exposure across multiple strategic AI programs.
Learn More About Autodesk Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
Salary transparency Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.
Diversity & Belonging We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging
Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site).
About Autodesk
Autodesk is changing how the world is designed and made.
Our technology spans architecture, engineering, construction, product design, manufacturing, and media and entertainment. We empower innovators everywhere to solve challenges, big and small. From greener buildings to smarter products and more mesmerizing blockbusters, Autodesk software helps our customers design and make a better world for all.
Over 100 million people use Autodesk software, like AutoCAD, Revit, Maya, 3ds Max, Fusion 360, SketchBook, and more, to unlock their creativity and solve important design, business, and environmental challenges. Our software runs on both personal computers and mobile devices. It taps the infinite computing power of the cloud to help teams around the world collaborate, design, simulate, and fabricate their ideas in 3D.
We provide exceptional compensation and benefit packages, and we’d love for you to join us. We’re proud to be an equal opportunity employer, and we consider all qualified applicants without regard to race, gender, disability, veteran status, or other protected category. To see our culture in action, check out #AutodeskLife.
We are headquartered in the San Francisco Bay Area and have over 10,000 employees worldwide.
Similar jobs you might like
About the role
Job Requisition ID # 26WD94926
About The Role Join Autodesk’s AEC Design organization to help build, evaluate, and scale the next generation of AI-powered and agentic experiences and future MCP-based workflows!
You will work closely with senior Data Scientists, Software Engineers, and product teams to develop reliable ML models, evaluate LLM-driven tool calling, and contribute to unified LLM evaluation frameworks used across AEC. This role is ideal for an early-career engineer with strong ML fundamentals, curiosity for new AI technologies, and comfort working across both experimentation and engineering.
Responsibilities
- Develop and evaluate ML models (classification, regression, clustering, forecasting).
- Support LLM evaluation workflows, including dataset creation, metrics, and benchmarking for MCP and Assistant scenarios.
- Run offline batch evaluations and contribute to real-time evaluation instrumentation (Opik, Langfuse, custom pipelines).
- Collaborate with engineering teams to integrate models into production workflows with CI/CD best practices.
- Build scripts, utilities, and small pipelines to automate data preparation, experiments, and evaluation.
- Partner with PMs, domain experts, and cross-product teams to translate user scenarios into measurable evaluation tasks.
Minimum Qualifications
- Bachelor’s (2–3 years experience) or Master’s (new grad welcome) in CS, Data Science, Engineering, or similar.
- Strong Python skills and experience with ML fundamentals (feature engineering, training, validation).
- Familiarity with scikit-learn, pandas, NumPy; deep learning frameworks a plus.
- Experience with LLMs, prompt evaluation, or toolcalling workflows
- Understanding of CI/CD, git, and sound software engineering practices.
- Ability to analyze model quality using metrics, error analysis, and experiment tracking.
- Nice to have: experience with MCP, model evaluation frameworks, time-series data, cloud environments (AWS/Azure), Opik/Langfuse.
Why Autodesk?
- Work on cutting-edge ML and LLM technologies shaping the future of AEC design.
- Contribute to cross-product AI initiatives (Tyto, AA, MCP, Agentic Accelerator).
- Learn from and collaborate with experienced scientists, engineers, and product teams.
- Clear growth opportunities and exposure across multiple strategic AI programs.
Learn More About Autodesk Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
Salary transparency Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.
Diversity & Belonging We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging
Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site).
About Autodesk
Autodesk is changing how the world is designed and made.
Our technology spans architecture, engineering, construction, product design, manufacturing, and media and entertainment. We empower innovators everywhere to solve challenges, big and small. From greener buildings to smarter products and more mesmerizing blockbusters, Autodesk software helps our customers design and make a better world for all.
Over 100 million people use Autodesk software, like AutoCAD, Revit, Maya, 3ds Max, Fusion 360, SketchBook, and more, to unlock their creativity and solve important design, business, and environmental challenges. Our software runs on both personal computers and mobile devices. It taps the infinite computing power of the cloud to help teams around the world collaborate, design, simulate, and fabricate their ideas in 3D.
We provide exceptional compensation and benefit packages, and we’d love for you to join us. We’re proud to be an equal opportunity employer, and we consider all qualified applicants without regard to race, gender, disability, veteran status, or other protected category. To see our culture in action, check out #AutodeskLife.
We are headquartered in the San Francisco Bay Area and have over 10,000 employees worldwide.