Skip to main content
Angi

Principal Product Manager, AI Platform

RemoteUnited States only
Published
Role
Product
Experience
Principal
Employment
Full-time
$190k–$280k/yr
Check eligibility

Open to US only. Set where you work from to check your eligibility.

No BS summary

Principal-level technical product manager for an AI/ML infrastructure platform. Needs 8+ years in Product Management, including 4+ years on infrastructure, platforms, ML/AI systems, or technical products for internal engineering/data-science customers. Remote role hiring in the United States.

Core skills

AI/MLLLM gatewaysModel serving

Required skills

API gatewaysKubernetes

Optional skills

LiteLLMLangfuseKServeSageMakerBedrockRay

What you'll do

  • Own the vision, strategy, and roadmap for the AI Platform.
  • Own the vision for a governed, model-agnostic gateway that all model and agent traffic routes through.
  • Define per-team and per-use-case cost attribution, flexible model routing, rate limiting, provider failover, automatic spending caps, and stop switches.
  • Make model-swap and cost decisions changeable once at the gateway, not per service.
  • Define the roadmap for the eval engine and the pass/fail gate that runs on it.
  • Define eval-gated prompt management with versioning and rollback.
  • Define per-agent accuracy scoring so quality regressions are caught before reaching users.
  • Define and champion the trust-and-autonomy ladder for agent independence.
  • Define thresholds, progression criteria, evidence, approvals, and rollback logic for agent autonomy.
  • Own the production path for self-hosted LLM/open-weight model serving and traditional ML.
  • Consolidate ML and LLM workloads under one standardized observable platform.
  • Define and instrument metrics that track platform health and business impact.
  • Establish partnerships with product engineering, architecture, and data science to drive adoption.
  • Ensure the platform reflects how teams build and serve models.
  • Manage a complex platform backlog spanning parallel tracks under capacity constraints.
  • Make and communicate sequencing and trade-off decisions clearly.
  • Act as the primary interface between technical platform teams and business stakeholders.
  • Translate infrastructure investment into clear business outcomes.

What they require

  • 8+ years of experience in Product Management.
  • At least 4 years focused on infrastructure, platforms, ML/AI systems, or other technical products serving internal engineering or data-science customers.
  • Proven track record scaling technical platforms from inception through maturity for demanding internal customers.
  • Technical fluency across the modern AI/ML stack, including model serving and inference, API gateways/proxies, evaluation and testing frameworks, and cloud/Kubernetes infrastructure.
  • Ability to discuss architecture trade-offs with engineers and data scientists.
  • Demonstrated ability to use telemetry and cost data to diagnose bottlenecks and drive product strategy.
  • Preferred: Experience with prompt management and versioning, LLM fine-tuning, or self-hosted/open-weight model serving in production.
  • Preferred: Familiarity with agent governance concepts, including guardrails, PII controls, prompt-injection protection, and autonomy/trust frameworks.
  • Preferred: Familiarity with the tension between agent velocity and cost control.
  • Preferred: Experience operating a platform across competing tracks and stakeholders.
  • Preferred: Experience sequencing revenue-critical stabilization work alongside a new strategic build-out.
  • Preferred: Exceptional leadership skills with a history of influencing cross-functional teams without direct authority.

Benefits

  • Competitive year end performance bonus.
  • Equity package.
  • Full medical, dental, vision package.
  • Flexible vacation policy.
  • Pet discount plans.
  • Retirement plan with company match (401K).
  • Opportunity to work with sharp, motivated teammates solving unique challenges.

Angi powers the home services industry, helping homeowners find skilled pros and helping service professionals find work.

Home ServicesEnterpriseang.sagepub.com/

Details

Apply routeDom
$190k–$280k/yr