User Experience Designer
About the role
Join a specialized project focused on evaluating large language models (LLMs) within professional UX and product design workflows. This role centers on identifying and mitigating contextual misuse risks in AI-generated outputs, such as privacy violations, manipulative patterns, and unsafe advice. You will assess LLM responses to prompts related to onboarding flows, consent mechanisms, healthcare and finance UX patterns, and accessibility. The position requires developing or refining scoring rubrics that address privacy risk, dark patterns, policy evasion, user harm, and clarity. You will deliver concise evaluations, including scores, rationales, and actionable recommendations for safer outputs, and design red-team prompts that simulate realistic misuse scenarios. This opportunity is ideal for experienced UX professionals with a strong background in regulated domains and a passion for advancing AI safety.
Responsibilities
- Review and evaluate LLM outputs for a range of UX/product design scenarios, focusing on risk factors such as privacy, manipulation, and user safety
- Develop, refine, and apply structured scoring rubrics across multiple risk dimensions
- Write clear, concise evaluations with scores, rationales, and improvement suggestions
- Propose and design red-team prompts to test model robustness against misuse
- Collaborate with stakeholders to ensure evaluation criteria align with industry standards and regulatory requirements
Skills And Requirements
- Minimum 7 years of experience in UX/Product Design or UX Research, preferably in regulated sectors (e.g., healthcare, finance)
- Proven expertise in developing evaluation rubrics or conducting structured reviews
- Deep understanding of privacy-by-design, consent UX, accessibility standards, and risk assessment in persuasive UX
- Strong analytical and written communication skills, with the ability to articulate complex findings clearly
- Familiarity with AI/LLM safety, policy evasion, and user harm mitigation is highly desirable
- Ability to work independently and deliver high-quality, actionable insights within set timelines
About Twine Twine is a leading freelance marketplace connecting top freelancers, consultants, and contractors with companies needing creative and tech expertise. Trusted by Fortune 500 companies and innovative startups alike, Twine enables companies to scale their teams globally.
Our Mission Twine's mission is to empower creators and businesses to thrive in an AI-driven, freelance-first world.
About Twine
Twine connects companies to over 750,000 freelance experts across 190+ countries. We enable flexible work opportunities for so many talented people. Twine covers tech, creative and AI – Software development, graphic design, animation, marketing, video products and everything in between.
STARTUPS (www.twine.net) Companies need a flexible and global workforce to keep competitive. However, they struggle to find specific experts to match their needs. If you have niche technical/creative requirements or need a freelancer in a specific location – we can help you.
FREELANCERS and CONSULTANTS (www.twine.net/freelancers) If you're a freelancer or consultant, take control and choose which projects you want to work on. Build your portfolio with Twine and find interesting jobs from all over the world.
AI COMPANIES (www.twine.net/ai) If you're a company that uses machine learning and needs audio-visual datasets, we can use our network of diverse freelancers to build this for you. Text to speech, video, actors, presenters, and more.
User Experience Designer
About the role
Join a specialized project focused on evaluating large language models (LLMs) within professional UX and product design workflows. This role centers on identifying and mitigating contextual misuse risks in AI-generated outputs, such as privacy violations, manipulative patterns, and unsafe advice. You will assess LLM responses to prompts related to onboarding flows, consent mechanisms, healthcare and finance UX patterns, and accessibility. The position requires developing or refining scoring rubrics that address privacy risk, dark patterns, policy evasion, user harm, and clarity. You will deliver concise evaluations, including scores, rationales, and actionable recommendations for safer outputs, and design red-team prompts that simulate realistic misuse scenarios. This opportunity is ideal for experienced UX professionals with a strong background in regulated domains and a passion for advancing AI safety.
Responsibilities
- Review and evaluate LLM outputs for a range of UX/product design scenarios, focusing on risk factors such as privacy, manipulation, and user safety
- Develop, refine, and apply structured scoring rubrics across multiple risk dimensions
- Write clear, concise evaluations with scores, rationales, and improvement suggestions
- Propose and design red-team prompts to test model robustness against misuse
- Collaborate with stakeholders to ensure evaluation criteria align with industry standards and regulatory requirements
Skills And Requirements
- Minimum 7 years of experience in UX/Product Design or UX Research, preferably in regulated sectors (e.g., healthcare, finance)
- Proven expertise in developing evaluation rubrics or conducting structured reviews
- Deep understanding of privacy-by-design, consent UX, accessibility standards, and risk assessment in persuasive UX
- Strong analytical and written communication skills, with the ability to articulate complex findings clearly
- Familiarity with AI/LLM safety, policy evasion, and user harm mitigation is highly desirable
- Ability to work independently and deliver high-quality, actionable insights within set timelines
About Twine Twine is a leading freelance marketplace connecting top freelancers, consultants, and contractors with companies needing creative and tech expertise. Trusted by Fortune 500 companies and innovative startups alike, Twine enables companies to scale their teams globally.
Our Mission Twine's mission is to empower creators and businesses to thrive in an AI-driven, freelance-first world.
About Twine
Twine connects companies to over 750,000 freelance experts across 190+ countries. We enable flexible work opportunities for so many talented people. Twine covers tech, creative and AI – Software development, graphic design, animation, marketing, video products and everything in between.
STARTUPS (www.twine.net) Companies need a flexible and global workforce to keep competitive. However, they struggle to find specific experts to match their needs. If you have niche technical/creative requirements or need a freelancer in a specific location – we can help you.
FREELANCERS and CONSULTANTS (www.twine.net/freelancers) If you're a freelancer or consultant, take control and choose which projects you want to work on. Build your portfolio with Twine and find interesting jobs from all over the world.
AI COMPANIES (www.twine.net/ai) If you're a company that uses machine learning and needs audio-visual datasets, we can use our network of diverse freelancers to build this for you. Text to speech, video, actors, presenters, and more.