Risk Modeler III, Model Risk & AI, GenAI Model Validation — Las Vegas, NV
Зарплата не указана
ОткликнутьсяDescription
Position Summary
The Risk Modeler III, Model Risk & AI, GenAI Model Validation is responsible for high-quality independent validation of quantitative, machine-learning, generative AI, and agentic AI models and tools. The role assesses whether methodologies, implementation, performance, controls, and monitoring are appropriate for their intended use and comply with Model Risk Management policies, standards, procedures, and applicable regulatory guidance. This role requires advanced technical expertise and minimal supervision to lead complex validations and remain accountable for validation conclusions across a wide range of model categories.
Summary Essential Job Functions
• Lead end-to-end validation of generative AI, agentic AI, machine learning, and LLM-based models and tools to determine whether they perform effectively and are appropriate for their intended use.
• Assess data suitability, conceptual soundness, implementation, robustness, reliability, explainability, human oversight, autonomy, controls, limitations, monitoring, and production readiness.
• Design and execute AI-specific testing, including benchmarking, sensitivity and stress testing, stability and drift analysis, hallucination and output-reliability testing, explainability assessments, and evaluation of model limitations.
• Independently identify material AI risks, provide credible challenge to Model Development and business stakeholders, and clearly communicate validation conclusions, limitations, and findings to management.
• Lead the review and maintenance of relevant model validation documentation, perform in depth analysis on large data sets, and prepare analysis and reports to support discussions on key analytics, model performance and risks.
• Enhance the existing GenAI model validation framework by developing standardized performance and reliability metrics.
• Stay informed of developments in AI/ML, generative AI, agentic systems, validation methods, regulatory expectations, academia, risk technology, and the financial services industry.
• Work closely within the Risk and other relevant functions to validate accuracy and performance of models and to identify issues requiring further investigation.
• Support regulatory examinations and internal audits of the modeling process and selected model’s samples.
• Continuously drive better model risk management practices and add value to the business through more efficiency, stronger controls, better process, and strong partnership with model stakeholders.
• Perform other duties and/or special projects as assigned.
Position Requirements
• Bachelor's degree in Artificial Intelligence, Machine Learning, Computational Science, Engineering, Statistics, Mathematics, Economics, or related Quantitative field.
• Strong technical knowledge of machine-learning and AI methodologies, with demonstrated ability to evaluate generative AI, large language models, and agentic AI systems.
• Demonstrated proficiency in Python and SQL, or comparable analytical tools, for independent testing and validation of statistical, machine-learning, and AI solutions.
• Excellent written and communication skills and ability to create and maintain quality model documentation.
• Ability to collaborate effectively and follow-up to ensure achievement of deadlines, outcomes, and results.
• Effectively communicate model findings to model owners and developers
• Ability to work independently and self-motivate in a fast-paced and rapidly changing environment.
Preferred
• Master’s degree or Ph.D. in Artificial Intelligence, Machine Learning, Computational Science, Engineering, Statistics, Mathematics, Economics, or related Quantitative field is required, and 4+ years of work-related experience in an analytics role, with a minimum of 3 years of model development/model validation experience in financial services, banking, or retail etc. with 1+ years focused on GenAI and/or agentic AI.
• Experience with AI/ML evaluation frameworks and LLM testing tools used to assess generative AI and agentic AI systems.
• Experience validating behavioral, credit, fraud, or other financial-services models developed using advanced analytics, machine learning, or AI.
• Familiarity with AI governance frameworks and emerging regulatory expectations.
• Experience leading complex validation projects, developing actionable plans, and delivering results within established timelines.
• Experience supporting regulatory examinations, internal audits, or model-risk governance reviews.
• Strong knowledge of current model risk management guidance, including SR 26-2 and OCC Bulletin 2026-13, as well as AI-specific governance and supervisory expectations under the OCC Supervision Intelligence Framework.
• Experience in people and project management, including demonstrated ability to develop actionable plans to meet high level objectives, strong execution, and timeline sensitive deliverables.
9Qu5kY GCf uA7z, N.A. is a data-driven financial services company based in Las Vegas. Founded in 1984, 9Qu5kY GCf uA7z offers a spectrum of credit card products for people in all stages of financial life. 9Qu5kY GCf uA7z is an equal opportunity employer committed to diversity and inclusion and does not discriminate against any employee or applicant for employment because of age, race, religion, color, disability, sex, sexual orientation, or national origin. Reasonable accommodations can be made for those who require them, including access to job applications and workplace accommodations. Employment at 9Qu5kY GCf uA7z is based on mutual consent (also known as at-will). This means that employees and the xB9g may terminate the employment relationship at any time, with or without cause and with or without notice. Please contact the recruiter for this position to learn more. 9Qu5kY GCf uA7z does not accept unsolicited resumes from agencies and is not responsible for related fees.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.