Skip to main content
LaunchDarkly
LaunchDarkly

Head of Experimentation

RemoteUnited States only
Published
Role
Product
Experience
C-Level
Employment
Full-time
$301k–$414k/yr
Check eligibility

Open to US only. Set where you work from to check your eligibility.

No BS summary

Senior product leader for a US-remote experimentation platform role. Needs deep operator-level experimentation methodology, data infrastructure, warehouse-native product experience, and credibility with data science leaders. Must lead product strategy, roadmap, commercial outcomes, and a function spanning engineering, design, and data science.

What you'll do

  • Own the Experimentation pillar.
  • Directly lead the Product team.
  • Partner with Engineering and Design counterparts in a triad model.
  • Be accountable for the pillar's strategy, roadmap delivery, and commercial outcomes.
  • Make the investment case across the in-product experimentation experience, warehouse-native analysis layer, and infrastructure that scales them.
  • Make experimentation the measurement layer of the AI SDLC.
  • Partner with AI product, observability, and core feature management leaders to productize existing capabilities as AI-native primitives.
  • Build a closed loop from offline evaluation through production experiments, automatic promotion and rollback, and a self-improving feedback loop for agents.
  • Win the high-maturity buyer.
  • Earn the technical confidence of senior data scientists and data-focused PMs.
  • Decide what statistical depth, warehouse coverage, and experiment-first workflow capabilities are non-negotiable and ship them on a timeline that wins pivotal reference deals.
  • Make warehouse-native a weapon.
  • Expand coverage across major data warehouses and query layers.
  • Deliver parity on analysis-only mode, variance reduction, ratio and percentile metrics, exposure validation, and arbitrary-window analysis.
  • Operate a high-performing function.
  • Run a disciplined roadmap.
  • Ship predictably against quarterly commitments.
  • Drive AI-assisted engineering productivity inside the organization.
  • Hire where gaps exist.
  • Be the external face of the category.
  • Represent the product with data scientists, PMs, experimenters, analysts, and partners.
  • Translate the strategy to the field and equip sales to win head-to-head.

What they require

  • Senior product leader (GM, VP, or equivalent) with a track record of owning a product line that competes on statistical rigor and data infrastructure.
  • Deep, operator-level fluency in experimentation methodology: causal inference, variance reduction, ratio metrics, sequential testing, exposure design, multi-armed bandits, and composite/multi-objective metrics.
  • Experience running experimentation at scale against production data warehouses and against non-deterministic systems where output variance, not just user variance, drives sample-size and significance decisions.
  • Credibility with data science leaders and experimentation specialists at sophisticated organizations, with ability to recruit them.
  • Experience leading a function that includes engineering, design, and data science.
  • Comfortable setting a multi-quarter roadmap, championing investment allocation, and reporting results to an executive team and board.
  • Clear, direct communicator.
  • Decides fast with incomplete information.
  • Prefers shipping and learning to requirements documents.
  • Opinionated about where experimentation is going in an AI-native world, specifically how agents and autonomous systems will use experimentation infrastructure differently than human teams do.
  • Preferred: Built or scaled experimentation at an organization where it was core infrastructure, not a secondary analytics capability.
  • Preferred: Personally won competitive evaluations where a sophisticated data-science organization was the deciding voice.
  • Preferred: Shipped warehouse-native data products and understands the operational realities of running experiments directly against customer data infrastructure.
  • Preferred: Sees experimentation as how software teams prove that any change, whether built by a person or an AI agent, actually worked.

Benefits

  • 20% bonus included in all zones.
  • Restricted Stock Units (RSUs).
  • Health insurance.
  • Vision insurance.
  • Dental insurance.
  • Mental health benefits.

American feature management and AI control software company

🇺🇸 United StatesSoftwareMid-sizelaunchdarkly.com

Details

Apply routeGreenhouse
$301k–$414k/yr