I AM HIRED

Неделя 310 ₽Месяц 630 ₽3 месяца 1 680 ₽Год 5 680 ₽

Agent Operations Engineer (LLMOps) — Los Angeles County, CA

ML и AI, MLOps · сегодня, 13:42 · 16.11.2026

Зарплата не указана

Откликнуться

Компания: ••••••••

Локация: Los Angeles County, CA

Формат: не указан

Занятость: Полная занятость

Грейд: Senior

About the Role

We are building local engineering teams in Singapore and the United States and are looking for an Agent Operations Engineer with strong AI application knowledge and solid operations engineering skills. You will own the production stability, quality, and ongoing operations of our AI agent products. Your responsibilities include prompt management, knowledge base maintenance, model configuration, performance monitoring, incident response, and staged rollouts—working closely with product, algorithm, and engineering teams to ensure our AI agents run reliably and effectively in production.

This is a hands-on role that blends technical depth with product awareness. We expect you to deeply understand the engineering characteristics of LLM applications, establish standardized agent operations practices, and maintain strong sensitivity to user experience and business outcomes.

Responsibilities

• Own production operations of AI agents, including model service configuration, prompt versioning, knowledge base updates, and tool calling configuration

• Build an agent performance monitoring system tracking response quality, TTFT, total latency, token cost, and user satisfaction

• Lead rapid incident triage and root-cause analysis, coordinating with algorithm and engineering teams on fixes and systemic improvements

• Manage staged rollouts, A/B testing, and evaluation workflows for agent iterations

• Maintain and optimize prompt templates, tool configurations, and knowledge base content to continuously improve answer quality

• Establish a Bad Case collection, classification, analysis, and closed-loop tracking mechanism with regular review reports

• Own safety and compliance checks for agents, including content safety, privacy protection, access control, and privilege escalation prevention

• Write operations documentation, runbooks, and emergency response procedures

• Collaborate with product teams to translate user feedback and production data into agent improvement requirements

• Adopt AI Coding tools to automate operations workflows and improve efficiency

Qualifications

• 3+ years in software development, operations, or technical support, with AI / LLM project experience

• Solid understanding of LLM application engineering: prompt engineering, RAG, function calling, streaming, and context management

• Production operations experience with monitoring, alerting, log analysis, troubleshooting, and incident response

• Proficient in Python for writing operations scripts, data processing, and automation

• Working knowledge of LLM fundamentals and common issues (hallucination, latency variance, cost control, safety boundaries)

• Experience with A/B testing and evaluation, including experiment design and result analysis

• Strong analytical and problem-solving skills in complex systems

• Professional fluency in both English and Chinese, including technical discussions, meetings, and written documentation

• Ability to work effectively across cultures, countries, and time zones

Поиск по вакансиям

Название компании скрыто

Названия компаний и их продуктов мы не публикуем на сайте — они доступны в Telegram-боте I AM HIRED. Откройте эту вакансию в боте: увидите название, сможете откликнуться и настроить рассылку подходящих вакансий.

Открыть вакансию в боте