Member of Technical Staff, AI Researcher (New Stealth Startup) — United States

For our client, we are seeking a Member of Technical Staff, AI Researcher to join the team of a leader in the Enterprise Technology space.

This is a highly technical role focused on advancing AI research into practical systems that improve model quality, evaluation rigor, and real-world performance.

You will work at the intersection of research and engineering, building frameworks that assess large language models and AI agents while also enabling faster experimentation and stronger alignment.

The role will partner closely with cross-functional technical teams to translate research questions into scalable experiments, robust datasets, and production-ready insights.

Location: Remote

Compensation: $250,000 – $400,000 annually

Responsibilities

• Design and build evaluation frameworks for large language models and AI agents

• Develop feedback systems to measure and improve model behavior

• Conduct supervised fine-tuning and reinforcement learning experiments

• Research what makes evaluations representative of real-world tasks

• Create systems for high-quality human data production

• Translate research questions into actionable experiments

• Prototype and diagnose findings to enhance benchmarks and datasets

• Collaborate across teams to advance technical roadmaps

• Contribute to the technical community through open-source tools and research

Qualifications

• 5+ years of experience in machine learning, AI, computer science, or related fields

• Ability to bridge AI research and software engineering

• Strong Python programming skills for scalable software development

• Hands-on experience with AI agents and reinforcement learning systems

• Understanding of frontier AI methods and evaluation techniques

• Experience with model-feedback systems like reward models and automated verifiers

• Proven ability to design evaluations measuring model performance and alignment

• Strong analytical and technical documentation skills

Benefits

• Career advancement opportunities with strong performance

• 100% employer-paid comprehensive health care for employees and families

• 14 weeks paid maternity and paternity leave

• Unlimited PTO with management approval

• Professional development and continued learning opportunities

• Optional 401K, FSA, and equity incentives

• Mental health benefits available through Tara Mind

• Cost-effective GLP-1 solutions through Crux

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.