GenAI Engineer — New York City Metropolitan Area

Job Title: Generative AI Engineer

Experience: 4-8 Years

Location: NYC, NY (Hybrid)

Job Summary

We are looking for a talented Generative AI Engineer to design, develop, and deploy AI-powered applications using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI Agents, and modern AI frameworks. The candidate will work closely with architects, data scientists, and product teams to build scalable GenAI solutions that solve real business problems.

Key Responsibilities

Generative AI Development

• Develop and deploy applications leveraging LLMs such as GPT-4, Claude, Gemini, Llama, and Mistral.

• Build conversational AI assistants, enterprise chatbots, and AI copilots.

• Design and implement prompt engineering and prompt optimization strategies.

• Fine-tune and evaluate foundation models where applicable.

• Develop AI workflows using Agentic AI frameworks.

RAG & Knowledge Systems

• Build and maintain Retrieval-Augmented Generation (RAG) solutions.

• Develop document ingestion, chunking, embedding, and retrieval pipelines.

• Integrate vector databases such as Pinecone, Weaviate, ChromaDB, Azure AI Search, or Qdrant.

• Optimize search relevance, grounding, and response quality.

AI Framework Development

• Develop applications using:

• LangChain

• LlamaIndex

• Semantic Kernel

• LangGraph

• CrewAI

• AutoGen

• Create reusable AI components and accelerator frameworks.

API & Application Integration

• Integrate GenAI services with enterprise applications.

• Develop RESTful APIs and microservices for AI workloads.

• Collaborate with frontend and backend teams to deliver end-to-end AI solutions.

• Implement AI model monitoring and feedback mechanisms.

Cloud & DevOps

• Deploy AI applications on Azure, AWS, or GCP.

• Build CI/CD pipelines for GenAI solutions.

• Use Docker and Kubernetes for containerization and orchestration.

• Monitor and optimize costs, latency, and performance.

Security & Responsible AI

• Implement responsible AI practices, content filtering, and model guardrails.

• Ensure compliance with data privacy, security, and governance standards.

• Address hallucination, bias, and prompt injection risks.

Required Qualifications

Education

• Bachelor's or Master's degree in Computer Science, Information Technology, Artificial Intelligence, or a related field.

Experience

• 3-8 years of software development experience.

• 1+ years of hands-on experience with Generative AI or LLM-based solutions.

• Experience building AI-powered applications in production environments.

Technical Skills

Programming Languages

• Python (Mandatory)

• Java (Preferred)

• JavaScript/TypeScript

• SQL

Generative AI & LLMs

• OpenAI GPT Models

• Azure OpenAI Service

• Anthropic Claude

• Google Gemini

• Llama Models

AI Frameworks

• LangChain

• LlamaIndex

• Semantic Kernel

• LangGraph

• CrewAI

Vector Databases

• Pinecone

• ChromaDB

• Weaviate

• Qdrant

• Azure AI Search

Cloud Platforms

• Microsoft Azure

• AWS

• Google Cloud Platform

DevOps Tools

• Docker

• Kubernetes

• GitHub Actions

• Azure DevOps

• Terraform

Preferred Qualifications

• Experience with Agentic AI and Multi-Agent Systems.

• Knowledge of MLOps and LLMOps practices.

• Experience with model evaluation frameworks such as RAGAS, TruLens, DeepEval, or Promptfoo.

• Azure AI Engineer (AI-102), AWS AI Practitioner, or equivalent certifications.

Soft Skills

• Strong analytical and problem-solving abilities.

• Excellent communication and stakeholder management skills.

• Ability to work in Agile/Scrum environments.

• Strong collaboration and learning mindset.

Nice to Have

• Experience building AI copilots for enterprise applications.

• Exposure to Azure AI Foundry, AWS Bedrock, or Vertex AI.

• Experience with OCR, Document Intelligence, and Knowledge Management systems.

• Understanding of AI governance and Responsible AI frameworks