GenAI Prompt Engineering — New York, United States

We are seeking an experienced GenAI Prompt Engineer to design, develop, test, and optimize prompts for LLM-powered chatbots, AI agents, and Retrieval-Augmented Generation (RAG) systems.

The candidate will translate business requirements into reliable prompt and agent workflows while ensuring accuracy, consistency, security, and measurable performance improvements.

Key Responsibilities:

• Design, test, and refine prompts to maximize accuracy, relevance, and consistency.

• Build evaluation frameworks, including A/B testing, benchmarking, golden datasets, and rubric-based scoring.

• Apply strong knowledge of LLM behavior, context windows, tokenization, and fine-tuning versus prompting.

• Collaborate with product, engineering, and data science teams to design prompt and agent workflows.

• Implement prompt security and safety measures, including jailbreak prevention, bias mitigation, and guardrails.

• Maintain prompt versioning, regression testing, and continuous optimization.

Required Qualifications & Technical Skills:

• 5+ years of experience in Software, Data, or Applied AI roles.

• Minimum 1+ year of hands-on LLM prompt engineering experience in production.

• Strong Python scripting and API integration experience.

• Hands-on experience with GPT and Claude.

• Experience with LLM orchestration tools such as LangChain.

• Experience designing evaluation frameworks and improving LLM performance.

• Working knowledge of RAG architectures and AI agent patterns.

• Experience with tool calling and agent workflows.

• Strong data analysis skills to interpret evaluation results.