Skip to main content
Clear Street

Senior / Staff AI Model Engineer

RemoteUnited States only
Published
Role
AI / ML
Experience
Staff
Employment
Full-time
$200k–$350k/yr
Check eligibility

Open to US only. Set where you work from to check your eligibility.

No BS summary

Senior/Staff AI model engineer with 8+ years shipping production software. Needs experience building eval frameworks, benchmark suites, model improvement cycles, metrics pipelines, and production-quality AI systems for a trading platform.

Core skills

Evaluation frameworksBenchmark suitesModel improvement cycles

Required skills

Test harnessesDataset curationLabeling/QAOffline experimentationMeasurement pipelines

Optional skills

Fine-tuningPreference optimizationDistillationPrompt/compiler-style techniquesDomain-specific benchmarksAdversarial suitesRustPerformance-sensitive services

What you'll do

  • Own the reliability and quality bar for an AI copilot embedded in a trading platform used by sophisticated investors.
  • Design and build evaluation systems that measure correctness, safety, latency, and regression risk across market analysis, portfolio/risk reasoning, and trading workflows, including order placement.
  • Develop and maintain benchmarks, including curated golden sets, scenario suites, stress/adversarial cases, and continuously refreshed market/regime-based test corpora.
  • Build automated quality gates and regression workflows that block releases when key metrics degrade.
  • Partner with engineering and product to define safe tool/action contracts, including deterministic previews, confirmations, and auditability, and ensure predictable assistant behavior.
  • Own model improvement loops tied to evals, including data collection/labeling strategies, error taxonomy, prompt/tooling changes, and when appropriate, fine-tuning or preference optimization to measurably improve benchmark performance.
  • Design and operate monitoring and incident response for AI, including telemetry, alerting, RCA, and fix-forward processes.
  • Develop a deep understanding of trading concepts such as margin, shorting, portfolio margin, risk, and execution, and how to express them accurately and understandably to users.

What they require

  • At least eight (8) years of experience shipping production software; strong proficiency with any programming language.
  • Strong knowledge of computer science fundamentals, testing methodology, and systems design.
  • Experience building evaluation frameworks, test harnesses, and benchmark suites for complex systems such as LLMs, agents, search, retrieval, ranking, or recommenders.
  • Experience running model improvement cycles: dataset curation, labeling/QA, offline experimentation, and deploying changes with measurable impact on benchmarks.
  • Ability to define metrics, build measurement pipelines, and drive engineering/product decisions from data.
  • Comfort working across the stack: debugging model/tooling failures, instrumenting services, and partnering with frontend/product on UX patterns that improve safety and trust.
  • High degree of self-motivation and willingness to jump into unfamiliar areas to solve problems.
  • Preferred: Experience creating domain-specific benchmarks and adversarial suites such as known-bad scenarios for high-stakes applications.
  • Preferred: Deep experience with trading across asset classes, margin types, etc.
  • Preferred: Experience with Rust and performance-sensitive services.
  • Preferred: Experience designing incident response and SLOs for ML/AI systems.

Benefits

  • Competitive compensation packages.
  • Company equity.
  • 401k matching.
  • Gender neutral parental leave.
  • Full medical, dental and vision insurance.
  • Lunch stipends for in-office employees.
  • Fully stocked kitchens for in-office employees.
  • Happy hours for in-office employees.
  • Great location for in-office employees.
  • Amazing views for in-office employees.
  • Culture that promotes collaboration.

stock exchange in United States of America

Details

Apply routeGreenhouse
$200k–$350k/yr