Skip to main content
Benepass

Lead AI Systems Engineer

RemoteUnited States only
Published
Role
AI / ML
Experience
Lead
Employment
Full-time
Company size
Startup
$190k–$220k/yr
Check eligibility

Open to US only. Set where you work from to check your eligibility.

No BS summary

Staff-level AI systems/platform engineer for a U.S. remote role. Needs hands-on end-to-end AI systems experience with agents, tools, retrieval, evals, integrations, LLM APIs, CI/CD, developer tools, automation, and strong Python and/or TypeScript/JavaScript fundamentals.

Core skills

CI/CDLLM APIsAI agents

Required skills

Python/TypeScript/JavaScriptAPIsObservability

Optional skills

Agentic workflowsEval harnessesRAGKnowledge systemsOps automationWorkflow automation

What you'll do

  • Own the design and implementation of Benepass’s internal AI platform and strategy for company-wide leverage.
  • Use the engineering SDLC as the first beachhead while designing platform primitives that extend to Operations and other internal functions.
  • Stand up a pragmatic platform combining industry-leading tools such as Cursor and peers with in-house systems, integrations, and shared infrastructure.
  • Define the architecture for how models, tools, context, evaluations, secrets, and permissions are composed safely inside Benepass.
  • Build reusable primitives including agents, tool interfaces, retrieval/context layers, workflow runners, observability, and feedback loops.
  • Establish the foundation for reliable environments, secure access to internal systems and data, and reusable adoption patterns for new domains.
  • Drive AI-assisted coding, review, and delivery workflows that compress time from idea to PR to production.
  • Integrate AI into CI/CD so quality signals, summaries, risk checks, and developer feedback appear where engineers already work.
  • Identify SDLC bottlenecks such as local development, code review, test wait time, release friction, and knowledge gaps, and remove them with automation.
  • Measure PR/cycle time, adoption, developer satisfaction/DX, test speed and signal, and time-to-find knowledge.
  • Turn successful team-level experiments into platform defaults that scale across Engineering and inform patterns for non-engineering domains.
  • Own the strategy for AI-driven test generation, maintenance, and automation, especially where it unlocks broad end-to-end coverage.
  • Build systems that help engineers own quality through high-signal E2E coverage, faster feedback, lower flakiness, and less manual validation.
  • Partner with Platform and product teams to put intelligent quality gates into CI/CD and deployment workflows.
  • Use AI to improve regression detection, failure triage, and the loop from requirements to test plan to execution to root-cause analysis.
  • Create clarity on what quality belongs to every engineer versus what the AI/platform layer provides as shared leverage.
  • Design and ship agentic internal workflows that automate multi-step work, starting in Engineering and expanding to other teams.
  • Build knowledge/search systems so people and agents can find specs, decisions, runbooks, SOPs, and operational context quickly.
  • Connect agents to repos, CI, docs, issue trackers, ops tools, and internal dashboards with clear permissions and auditability.
  • Prioritize workflows with obvious ROI such as repetitive operational toil, cross-repo changes, test authoring, incident/context gathering, onboarding, and cross-functional SOPs.
  • Ensure AI systems are observable, evaluable, maintainable, and able to host automation outside the engineering SDLC without forking the architecture.
  • Operate as a Staff IC on Platform by setting direction, building the core, and embedding selectively where adoption and design feedback matter most.
  • Collaborate with engineers so systems are testable, scriptable, and easy to integrate into existing workflows, then apply the same enablement model with non-engineering partners.
  • Work with Engineering, Product, Design, Operations, and other leaders to choose the journeys and workflows worth automating first.
  • Provide documentation, reference implementations, guardrails, and golden paths so teams can adopt without heroics.
  • Raise the organizational bar for good AI-assisted work, starting with software delivery and expanding to broader internal automation.
  • Introduce standards for AI tool usage, prompt/tool patterns, evaluation, data handling, and human-in-the-loop controls across Engineering and other internal domains.
  • Build evaluation harnesses and quality metrics to know when AI systems help and when they create noise.
  • Make pragmatic build-vs-buy decisions that favor speed and leverage while investing in shared platform where it compounds company-wide.
  • Stay current on emerging coding agents, workflow agents, eval methods, and enterprise AI tooling, and bring the best of the ecosystem into Benepass deliberately.
  • Help Benepass adopt AI in a way that reduces toil, increases speed and coverage, and keeps humans in control of quality and production outcomes.

What they require

  • Shipped end-to-end AI systems including agents, tools, retrieval, evals, and integrations, not demos or notebooks.
  • Able to blend off-the-shelf tools such as Cursor-class agents with custom platform where it compounds.
  • AI-native in own workflow and clear-eyed about where the tools break.
  • Biased toward shipped leverage over endless proofs of concept and honest about AI failure modes.
  • Believes AI should augment people and raise quality bars, not replace judgment.
  • Proven staff or equivalent cross-functional/platform impact while still writing code.
  • Able to turn ambiguous 0→1 spaces into sequenced roadmaps with real adoption metrics.
  • Background in full-stack, developer tools, and/or infrastructure automation.
  • Able to embed selectively, prove value, then productize patterns onto a shared platform.
  • Able to partner across Engineering, Product, Design, and Operations without becoming a bottleneck.
  • Measures success by adoption and outcomes, not tool count or novelty.
  • Staff-level or equivalent platform/cross-functional impact shipping systems others depend on.
  • Strong programming fundamentals with Python and/or TypeScript/JavaScript preferred.
  • Experience building internal platforms, developer tools, or automation integrated into CI/CD.
  • Hands-on experience with modern AI systems: coding agents, LLM APIs, orchestration, and production operability.
  • Experience enabling quality through automation such as E2E/integration testing and intelligent quality gates.
  • Solid systems instincts including APIs, permissions, observability, and reliability.
  • Clear communicator who can set standards and drive multi-team adoption.
  • Preferred: fintech/regulated domains, or 0→1 platform ownership at a growth-stage company.

Benefits

  • Equity.
  • 95% coverage of medical, dental, and vision.
  • Fantastic benefits.
  • $250 WFH setup, one time.
  • $500/year Learning & Development Benefit.
  • $150/month cell phone + internet.
  • $100/month Wellness.
  • $100/month Co-working and Commuter Benefit.
  • Several team onsites a year.
  • Flexible PTO.

Benepass provides a customizable fintech platform that helps People teams implement, administer, and track employee benefits and perks.

FintechStartup

Details

Apply routeDom
$190k–$220k/yr