GenAI Prompt Engineer

Job summary

Design and refine prompts for generative AI systems, validate AI-generated responses, and develop test cases to assess accuracy, robustness, and user experience. Provide structured feedback and collaborate with data scientists, engineers, and product managers to improve AI model behavior and functionality.

Job details

Key Responsibilities: Prompt Writing: Design and refine creative, effective, and contextually relevant prompts for generative AI systems to maximize performance and accuracy across various use cases. AI Response Validation: Analyze and validate AI-generated outputs to ensure they meet quality standards, are contextually appropriate, and align with user needs. Test Case Development: Create and execute comprehensive test cases for AI generated responses, assessing robustness, accuracy, and user experience. Iteration and Feedback: Provide structured feedback to improve AI model behavior, performance, and overall functionality. Collaboration: Work closely with cross-functional teams including data scientists, engineers, and product managers to implement and test improvements. Experience: 5-8 years of professional experience in software development or automation testing. Minimum 1 year of hands-on experience with generative AI technologies, large language models (LLMs), or GPT-based systems. Strong understanding of natural language processing (NLP) principles. Proficiency in programming languages such as Python, JavaScript, or similar tools. Experience with automation frameworks and test scripting. Familiarity with AI and ML workflows is a plus. Strong analytical and problem-solving skills

What you’ll do

Design and refine prompts for generative AI systems, validate AI-generated responses, and develop test cases to assess accuracy, robustness, and user experience. Provide structured feedback and collaborate with data scientists, engineers, and product managers to improve AI model behavior and functionality.

Requirements

Requires 5–8 years of professional experience in software development or automation testing, including at least one year of hands-on experience with generative AI, LLMs, or GPT-based systems. Candidates should understand NLP principles and have programming and automation test scripting experience; familiarity with AI and ML workflows is a plus.

Listed skills

• Problem solving · Preferred
• Quality assurance · Preferred
• JavaScript · Preferred
• prompt engineering · Preferred
• Python · Preferred
• Cross-Functional Collaboration · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Prompt Engineering
• Generative AI
• Large Language Models
• Natural Language Processing
• Python
• JavaScript
• Automation Testing
• Test Case Development
• AI Response Validation
• Quality Assurance
• AI Model Evaluation
• Analytical Skills
• Problem-Solving
• Cross-Functional Collaboration

Job areas

• Technology
• Software
• Data & Analytics
• Engineering

More jobs from TechDoQuest