Senior Manager Experimentation, Testing, & Learning

Company Description

It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500®. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But this is just the beginning of our journey. Join us as we pursue our purpose to make the world work better for everyone.

Job Description

The Senior Manager, Experimentation, Testing, & Learning owns the quarterly experimentation roadmap and learning agenda that drives measurable improvements in buying group progression. This role runs end-to-end test governance across buying group experience, ensuring tests are designed well, implemented correctly, measured cleanly, and translated into clear scale or stop decisions. 

What you will own 

• Quarterly experimentation roadmap, learning agenda, and test portfolio aligned to brand, events, and integrated program goals with emphasis on buying group progression. 

• Test intake, prioritization, design standards, and readout templates used across teams. 

• Scaling criteria and playbooks for rolling out tests that show measurable lift. 

• Governance for experimentation processes, including decision rules and documentation standards. 

Responsibilities 

• Own and evolve the quarterly experimentation roadmap and learning agenda, aligned to brand, events, and integrated program goals with emphasis on buying group progression. 

• Manage test intake and prioritization using clear criteria, expected impact, feasibility, time-to-learn, and cross-channel applicability, maintaining balanced coverage across paid, owned, site, and creative. 

• Define and maintain test design standards: hypotheses, primary and secondary KPIs, success thresholds, guardrails, and decision rules. 

• Partner with Measurement to define incrementality approaches, holdouts, lift studies, geo tests, platform experiments and standardize efficiency metrics. 

• Partner with agency and platform teams to ensure clean implementation, consistent exposure rules, and strong QA across channels. 

• Coordinate with DX on site and landing page tests, including experimentation tooling, tagging, data layer dependencies, and conversion-path measurement. 

• Partner with creative and agency teams to structure creative tests (message, offer, asset variants) with clear learning objectives and measurement plans. 

• Standardize how results are reported — readout templates that clearly summarize lift, confidence, segment impacts, tradeoffs, and recommended decisions. 

• Lead quarterly readouts that drive decisions to scale, stop, iterate, or retest, with documented rationale. 

• Maintain scaling criteria and update global playbooks when tests show measurable lift and repeatability. 

Qualifications

• 7+ years in growth marketing, performance marketing, experimentation, analytics, or marketing operations with ownership of cross-channel testing programs and a track record of turning test results into strategic decisions. 

Hard Skills 

• Experimentation Design: A/B, multivariate, holdouts, lift studies, geo experiments and common design pitfalls to avoid 

• Cross-Channel Testing: paid media (programmatic, search, social), owned channels, site experience, and creative 

• Measurement Partnership: incrementality design, impact evaluation, and efficiency metric standardization 

• Agency & Platform Execution: clean test setup, QA, trafficking, and consistent measurement across partners 

• Reporting & Decision Frameworks: standardized readouts that drive repeatable scaling decisions 

Soft Skills (Leadership Competencies) 

• Strategic Vision: able to define a learning agenda that connects test-and-learn activity to business outcomes, not just optimization metrics 

• Cross-Functional Influence: drives alignment and adoption of experimentation standards across Media, Measurement, DX, Integrated Marketing, and agency partners 

• Decisiveness & Clarity translates ambiguous test results into clear, actionable recommendations for senior stakeholders 

• Accountability & Rigor holds the bar on test design quali