GenAI Prompt Engineer

Job summary

Design and refine prompts, validate AI-generated responses, and develop and execute test cases to assess quality, accuracy, robustness, and user experience. Provide structured feedback and collaborate with data scientists, engineers, and product managers to improve AI model behavior and functionality.

Job details

Position Name – GenAI Prompt Engineer Type of hiring – Subcon Location – Brampton, ON or Toronto, ON (Onsite) Job Description: Key Responsibilities: Prompt Writing: Design and refine creative, effective, and contextually relevant prompts for generative AI systems to maximize performance and accuracy across various use cases. AI Response Validation: Analyze and validate AI-generated outputs to ensure they meet quality standards, are contextually appropriate, and align with user needs. Test Case Development: Create and execute comprehensive test cases for AI generated responses, assessing robustness, accuracy, and user experience. Iteration and Feedback: Provide structured feedback to improve AI model behavior, performance, and overall functionality. Collaboration: Work closely with crossfunctional teams including data scientists, engineers, and product managers to implement and test improvements. Experience: 5-8 Years of professional experience in software development or automation testing. Minimum 1 Years of hands-on experience with generative AI technologies, large language models (LLMs), or GPT-based systems. Strong understanding of natural language processing (NLP) principles. Proficiency in programming languages such as Python, JavaScript, or similar tools. Experience with automation frameworks and test scripting. Familiarity with AI and ML workflows is a plus. Strong analytical and problem-solving skills.

What you’ll do

Design and refine prompts, validate AI-generated responses, and develop and execute test cases to assess quality, accuracy, robustness, and user experience. Provide structured feedback and collaborate with data scientists, engineers, and product managers to improve AI model behavior and functionality.

Requirements

Requires 5–8 years of professional experience in software development or automation testing and at least 1 year of hands-on experience with generative AI, LLMs, or GPT-based systems. Candidates should understand NLP principles, be proficient in Python, JavaScript, or similar languages, and have experience with automation frameworks and test scripting; familiarity with AI/ML workflows is a plus.

Listed skills

• prompt engineering · Preferred
• Python · Preferred
• JavaScript · Preferred
• Problem solving · Preferred
• Cross-Functional Collaboration · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Prompt Engineering
• Generative AI
• Large Language Models
• GPT-Based Systems
• Natural Language Processing
• Python
• JavaScript
• Automation Testing
• Test Case Development
• AI Response Validation
• Automation Frameworks
• Test Scripting
• Analytical Skills
• Problem-Solving
• Cross-Functional Collaboration

Job areas

• Technology
• Software
• Data & Analytics

More jobs from Yochana