Skip to main content
Prime Intellect

Research Engineer - Distributed Training

RemoteUnited States only
Published
Role
AI / ML
Employment
Full-time
Company size
Startup
$150k–$350k/yr
Check eligibility

Open to US only. Set where you work from to check your eligibility.

Required skills

PyTorchPyTorch Distributed/DeepSpeed/FSDP/Megatron/vLLM/Ray

Optional skills

CUDATriton

What you'll do

  • Build and optimize the distributed training infrastructure behind our pre-training and large-scale RL training workloads by contributing to our prime-rl https://github.com/PrimeIntellect-ai/prime-rl framework.
  • Improve end-to-end training efficiency across compute, memory, networking, and scheduling layers.
  • Design and implement low-level performance optimizations, including kernels, communication paths, and runtime improvements.
  • Work on distributed training systems spanning data, tensor, and pipeline parallel workloads.
  • Help shape the architecture of our RL training stack, including async rollout and post-training systems.

What they require

  • Strong systems engineering experience in AI/ML infrastructure, especially around large-scale model training or inference.
  • Deep familiarity with PyTorch and distributed training frameworks such as PyTorch Distributed, DeepSpeed, FSDP, Megatron, vLLM, Ray, or related tooling.
  • Experience optimizing training performance across kernels, memory movement, communication overhead, or parallelization strategy.
  • Hands-on experience with large-scale training techniques including data parallelism, tensor parallelism, and pipeline parallelism.
  • Strong understanding of GPU architecture, profiling, and performance debugging.

Benefits

  • Cash Compensation Range of $150-350k, plus equity incentives, aligning your success with the growth and impact of Prime Intellect.
  • Flexible work arrangements, with the option to work remotely or in-person at our offices in San Francisco.
  • Visa sponsorship and relocation assistance for international candidates.
  • Quarterly team off-sites, hackathons, conferences and learning opportunities.
  • Opportunity to work with a talented, hard-working and mission-driven team, united by a shared passion for leveraging technology to accelerate science and AI.
🇺🇸 United StatesAI InfrastructureStartupprimeintellect.ai

Details

Visa sponsorshipYes
$150k–$350k/yr