Software Engineer, Benchmarking
- Role
- Research
- Employment
- Full-time
Open to UTC-8…UTC+0. Set where you work from to check your eligibility.
No BS summary
Software Engineer needed to evaluate frontier AI models by running and maintaining benchmarking infrastructure and developing new benchmarks. Requires professional level English proficiency. Role is fully remote, with preference for candidates who can overlap with UTC-8 and UTC.
Required languages
Epoch AI is looking for a Software Engineer who will help us evaluate frontier AI models, enabling researchers, developers, and policymakers to better understand AI development. The role will involve running and maintaining our benchmarking infrastructure as well as contributing to the development of brand new benchmarks. About the role Please do not include a cover letter, photograph, or headshot of yourself, or any personal information that is not relevant to the role for which you're applying (including marital status, age, identity traits, etc.). We are looking for a Software Engineer to help us expand and develop our AI Benchmarking Hub. You will work closely with the rest of the benchmarking team to run and maintain benchmarks, integrate with AI providers, set up existing benchmarks to run on our infrastructure, help design and develop brand new benchmarks, and facilitate internal experiments. This role is fully remote, and we are able to hire in many countries. We invite anyone who is interested to apply, regardless of background, experience, or credentials. Applications are rolling.
What you'll do
- Run and maintain our benchmarking infrastructure
- Contribute to the development of brand new benchmarks
- Work closely with the rest of the benchmarking team to run and maintain benchmarks
- Integrate with AI providers
- Set up existing benchmarks to run on our infrastructure
- Help design and develop brand new benchmarks
- Facilitate internal experiments
What they require
- Please do not include a cover letter, photograph, or headshot of yourself, or any personal information that is not relevant to the role for which you're applying (including marital status, age, identity traits, etc.).
- We invite anyone who is interested to apply, regardless of background, experience, or credentials.
- We prefer candidates who can overlap with UTC–8 (Pacific Time) and UTC (Greenwich Mean Time), as most of our staff work in this range of time zones.
- We also prefer candidates who can travel: we hold three retreats per year, during which we record podcast episodes and other communication efforts.
- Epoch is committed to building an inclusive, equitable, and supportive community for you to thrive and do your best work.
- We’re committed to finding the best people for our team, so please don’t hesitate to apply for a role regardless of your age, gender identity/expression, political identity, personal preferences, physical abilities, veteran status, neurodiversity or any other background.
Benefits
- Epoch is committed to building an inclusive, equitable, and supportive community for you to thrive and do your best work.
Epoch AI is a research institute that investigates trends in machine learning and the economic consequences of AI. Its mission is to develop a comprehensive, publicly accessible knowledge base on AI that informs policymakers, industry leaders, and society at large.