qP - Senior Consultant | Product Engineering | Product Build and Configuration — San Francisco, CA
Зарплата не указана
ОткликнутьсяКомпания: ••••••••
Локация: San Francisco, CA
Формат: не указан
Занятость: Полная занятость
Грейд: не определён
Bravens t9E., a wholly owned subsidiary of yMWff3 aeU., is an information technology consulting and services company. Bravens is a leader in providing tailored staffing solutions across both IT and non-IT industries. We are in search of a highly motivated candidate to join our talented team and contribute to our ongoing success.
Job Title: Lead Experimentation Analyst
Location(s): San Francisco, CA 94133
Must have skills:
strong statistical expertise
digital experimentation experience
Nice to have skills:
excellent stakeholder communication
collaboration with Product, UX, Analytics, and Engineering teams to establish experimentation standards and best practices
Detailed Job Description
cTRDnK9WmXAvUbS 9SgYvVyxV — Lead
Overview
We’re looking for a Lead Experimentation Analyst to drive rigorous experimentation and measurement across our digital product portfolio. This role will serve as a practitioner and subject matter expert for website experimentation, partnering with Product, UX, Analytics, and Engineering teams to design high-quality experiments, evaluate results, and ensure product decisions are grounded in statistically sound evidence.
The ideal candidate combines strong statistical expertise with practical experience running digital experiments at scale and understands how to translate experimental results into clear business decisions.
Key Responsibilities:
• Partner with Product and UX teams to develop hypotheses, success metrics, and experimentation strategies for digital experiences
• Design A/B and multivariate experiments, including audience allocation, sample sizing, test duration, primary KPIs, and guardrail metrics
• Conduct statistical power analysis and determine minimum detectable effects for proposed experiments
• Analyze experiment results and determine statistical and practical significance
• Apply advanced experimentation techniques including variance reduction, sequential testing, heterogeneous treatment effect analysis, and other appropriate statistical methodologies
• Evaluate experiment validity, including sample ratio mismatch, instrumentation issues, novelty effects, traffic imbalance, and other sources of bias
• Develop measurement approaches for tests with uneven audience allocation or operational constraints
• Conduct segmentation and follow-up analyses to understand how experiment effects differ across devices, customer groups, product categories, and experiences
• Establish experimentation standards, governance, and best practices across digital product teams
• Partner with analytics implementation teams to validate tracking and ensure experiment data quality
• Translate experimental findings into clear launch, iterate, or stop recommendations for Product and senior stakeholders. Description:
Responsibilities:
• Reporting - influences direction of technical aspect of reports
• Develops strategy and takes ownership of technical solutions, including owning and influencing the technical roadmap
• Sets prioritization for domain areas
• Looks at ways to automate and standardize (such as reporting, campaign, domain, etc.) to scale and bring more value/impact
• Works across multiple brands
• Owns domain discussion with stakeholders and connects the dots with other programs and in-flight initiatives
• Manages vendors
• Develops best practices
• Leads development of new functionality, enhancements, and campaign optimization
Experience:
• Bachelor’s Degree or equiv. experience
• 4 - 6 years of experience working in respective domain area
• Advanced user of domain specific tools
• Strong business acumen with Retail industry knowledge
• Excellent verbal and written communication skills, and the experience to deliver non-technical presentations to business partners at Executive level
• Excellent attention to detail and strong organizational skills to manage multiple work requests, projects, and initiatives
• Experience guiding agencies/vendors work
• 1-2 years of experience as a team or peer lead coaching and mentoring junior members desired
Minimum years of experience: 8-10 years
The top 3 responsibilities would expect the Subcon to shoulder and execute:
• Partner with Product and UX teams to develop hypotheses, success metrics, and experimentation strategies for digital experiences
• Design A/B and multivariate experiments, including audience allocation, sample sizing, test duration, primary KPIs, and guardrail metrics
• Conduct statistical power analysis and determine minimum detectable effects for proposed experiments.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veterans or individuals with disabilities.