Skip to main content
Aleph

Staff+ Software Engineer, AI

RemoteCanada, United States only
Published
Role
Fullstack
Experience
Senior
Employment
Full-time
$130k–$350k/yr
Check eligibility

Open to CA, US only. Set where you work from to check your eligibility.

No BS summary

Every AI feature at Aleph runs on a shared foundation: which model handles which task, what context the model sees, what tools it can call, and how we measure whether it's getting better. This role owns them as a whole, including the model proxy and eval infrastructure everything runs through.

Core skills

prompt engineeringcontext engineeringcaching efficience

Required skills

LLM systemsLLM/evals/context managementmulti-model routing/multi-provider routingLLM APIs/agent frameworks/prod systems

What you'll do

  • Own the AI foundation product teams build on: model selection and routing, the model proxy layer, context management, and tool design
  • Own eval infrastructure. Work with customers and finance domain experts to define what excellent output looks like, then encode it in evals every team can run
  • Ship agentic features end to end, from v0 through the optimization loop: prompt and context engineering, caching, parallel tool calls, subagent patterns
  • Build observability into agent behavior so we can profile it, find bottlenecks, and decide what to fix with data
  • Track what's changing in agentic systems and bring the practices that prove out into how we build

What they require

  • You've shipped production LLM systems - evals, context management, multi-model or multi-provider routing - and can talk concretely about what broke and what you changed
  • You build proof of concepts, decide quickly, and ship v0s. Evals drive your quality bar
  • Strong judgment about abstractions: opinionated about design, pragmatic about shipping incrementally
  • Experience with LLM APIs and agent frameworks, and shipped user-facing products
  • You want to ship production systems, not do research
  • Adoption: teams you don't manage have picked up systems you built - because they were that good
  • Strong fundamentals: you can trace requests from UI to data store and make good technical decisions at every layer
  • High agency: background as a founder, engineering lead, or startup builder. You have a builder's mindset and find creative ways to ship
  • Pragmatism: you choose the fewest and simplest tools that will actually work
  • Craft: you care deeply about code quality and write code that's correct and easy to understand
  • Communication: clear, direct, and persuasive across technical and non-technical audiences
  • Experience: you've built complex B2B products, ideally from scratch

Benefits

  • Offers Equity

Digital Advertising

Information TechnologyStartup
$130k–$350k/yr