GenAI Prompt Engineer

Job summary

Design and refine prompts, validate AI-generated responses, and develop test cases to assess quality, accuracy, robustness, and user experience. Provide structured feedback and collaborate with data scientists, engineers, and product managers to improve AI model behavior and functionality.

Job details

Key Responsibilities: -Prompt Writing: Design and refine creative, effective, and contextually relevant prompts for generative AI systems to maximize performance and accuracy across various use cases. -AI Response Validation: Analyze and validate AI-generated outputs to ensure they meet quality standards, are contextually appropriate, and align with user needs. -Test Case Development: Create and execute comprehensive test cases for AI generated responses, assessing robustness, accuracy, and user experience. -Iteration and Feedback: Provide structured feedback to improve AI model behavior, performance, and overall functionality. -Collaboration: Work closely with cross-functional teams including data scientists, engineers, and product managers to implement and test improvements. Experience: -5-8 years of professional experience in software development or automation testing. -Minimum 1 year of hands-on experience with generative AI technologies, large language models (LLMs), or GPT-based systems. -Strong understanding of natural language processing (NLP) principles. -Proficiency in programming languages such as Python, JavaScript, or similar tools. -Experience with automation frameworks and test scripting. -Familiarity with AI and ML workflows is a plus. -Strong analytical and problem-solving skills.

What you’ll do

Design and refine prompts, validate AI-generated responses, and develop test cases to assess quality, accuracy, robustness, and user experience. Provide structured feedback and collaborate with data scientists, engineers, and product managers to improve AI model behavior and functionality.

Requirements

Requires 5–8 years of experience in software development or automation testing and at least one year of hands-on experience with generative AI, LLMs, or GPT-based systems. Candidates should understand NLP principles, be proficient in a programming language such as Python or JavaScript, and have experience with automation frameworks and test scripting.

Listed skills

• prompt engineering · Preferred
• Python · Preferred
• JavaScript · Preferred
• Quality assurance · Preferred
• Problem solving · Preferred
• Cross-Functional Collaboration · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Prompt Engineering
• Generative AI
• Large Language Models
• Natural Language Processing
• Python
• JavaScript
• Automation Testing
• Test Case Development
• AI Response Validation
• Quality Assurance
• Analytical Skills
• Problem-Solving
• Cross-Functional Collaboration

Job areas

• Technology
• Software
• Data & Analytics
• Engineering

More jobs from TechDoQuest