Agent Engineer [IC4]
- Role
- AI / ML
- Experience
- Senior
- Employment
- Full-time
Open to UTC-8…UTC-2 · Prefers NORTH AMERICA, EUROPE, United States. Set where you work from to check your eligibility.
The listing prefers candidates in North America, Europe, and United States.
No BS summary
Senior/staff-scope engineer for agent engineering: software engineering, machine learning, statistics, production models, evals, retrieval, and multi-step agentic systems. Must work remotely with at least 20 hours/week overlap with EST.
Core skills
Required skills
Optional skills
Hours & location
🌎 While we hire almost anywhere in the world, we have a preference for someone to reside in the following locations for this role. However, if you feel qualified, we welcome you to apply regardless of location. No matter what, working hours must overlap with EST for at least 20 hours/week.
Preferred locations:
- Europe
- North America
Why this job is exciting
Sourcegraph is at the forefront of building AI tools to solve the biggest problems in the software industry, problems that only get bigger as codebases grow and as more of the work is done by agents. The Code Understanding team owns the surfaces where that intelligence meets the developer: Deep Search, our agentic, multi-step answer engine across an enterprise's entire lineup of codebases, Query Assist, turning natural language queries Sourcegraph query syntax, Smart Hovers, concisely summarizing symbols right where devs need it, guided diff review, and the APIs that both humans and AI agents rely on every day.
Most of what makes those surfaces tick is agent engineering: a blend of software engineering, machine learning, and statistics. Agent engineering tells us which model to use and when, how to retrieve and pack context, how to measure answer quality, where to fine-tune or distill a smaller model to cut costs and latency, and how to expand a single LLM call into a reliable multi-step agent. As the senior agent engineer on Code Understanding, you'll be the technical owner of it: setting the agentic direction for the team, making our products measurably better, faster, and cheaper, and raising the team's fluency in building with models.
This is a senior role: we're hiring a technical leader, not just a strong individual contributor. You'll own the hardest, most ambiguous problems in this space, set standards others follow, and influence direction beyond your immediate team. You'll get the exhilarating chance to drive the vision on how we can provide the best code understanding experience on the market by combining our deterministic, large-scale systems and AI into experiences never seen before.
Concretely, you'll own work like:
- Agentic systems. You'll design and harden the multi-step, tool-using agent loops behind current and new agentic experiences, turning research and experiments into reliable, observable, and affordable products at enterprise scale.
- Pragmatic use of evaluations. Crafting agentic products means needing to tell when a change actually helped, which is hard when agents keep changing and the product keeps shifting. You'll bring judgment about where evaluations earn their keep, when to use targeted smoke tests and metrics, and how to avoid noise dressed up as rigor, so we can move fast with confidence.
- Models: selection, upgrading, and training. You'll decide which models we run where, drive upgrades, and fine-tune our own when that's the right call.
- Retrieval and context engineering. You'll push on how we ground models in a customer's code - retrieval, ranking, context windows, citations - to make answers more accurate and verifiable.
- Cost and latency. Every surface has a per-user economic budget. You'll treat cost and latency as product features, and profile, distill, cache, and right-size models so we can ship ambitious features sustainably.
You'll do this on a small, senior-leaning team that ships quickly, owns a lot of product surface, and has streamlined product management: engineers here talk to customers, frame the problem, and own it end-to-end. You'll have real agency over technical direction and a direct line to the impact of your work.
📅 Within one month, you will…
- Get the Code Understanding products and their model/agent pipelines running end-to-end locally, and land your first improvements to a model, prompt, retrieval path, or eval.
- Build a clear picture of where the AI engineering pain is, and the product surfaces most constrained by them.
- Get to know the team and our customers, and start forming your own opinions about where our agentic products should go next.
- Join the team's on-call support rotation.
📅 Within three months, you will…
- Own a meaningful agentic slice of the product end-to-end, driving it from problem-framing through rollout and measurement.
- Establish how the team ships model and prompt changes responsibly: the evals, dashboards, and guardrails that make quality and cost regressions visible before customers feel them.
- Begin up-leveling teammates in building with models by pairing with them, reviewing their code, and modeling good agent engineering instincts.
📅 Within six months, you will…
- Be the recognized technical authority for agent engineering and agentic systems on Code Understanding. You will be the person teammates, and increasingly the wider department, defer to on model, eval, and agent-design decisions.
- Have measurably moved the products: better answer quality, lower cost/latency, or new agentic capabilities that weren't feasible before.
- Be setting the direction of the team's roadmap where it intersects agents, bringing conviction, backed by evidence, about which bets are worth making, and pulling other engineers up to execute on them.
About you
You are a senior engineer and technical leader with hard-won skills in agent engineering - a blend of software engineering, machine learning, and statistics. This is a senior, high-leverage role that relies on your real agent engineering judgment applied to a fast-moving product, plus the ability to collaborate on steering technical direction and to be a force multiplier for a talented, product-minded team. You're equally comfortable reasoning about an eval harness, a fine-tuning run, a retrieval pipeline, and the multi-step agent loop that ties them together, and you make everyone around you better at all of it.
You operate at staff scope: you own the most ambiguous, highest-risk problems in your domain, go into whatever codebase a problem requires, set standards and patterns others adopt, and translate fluidly between engineering goals and business objectives. You influence direction beyond your immediate team. You lead through technical excellence and mentorship.
- You have real agent engineering depth. You've built, trained, evaluated, and operated models in production. You think naturally in terms of datasets, evals, baselines, metrics, and error analysis, and you know how to tell whether a change actually made things better.
- You build with agents, fluently and opinionatedly. You've designed multi-step agentic systems and made them reliable, observable, and cost-bounded. You have a point of view on where agents shine and where deterministic code or human judgment is required.
- You are pragmatic about evaluations and conscious of cost. You know where evaluations earn their keep and where they mislead. You reach for lightweight smoke tests and real-world feedback first, and you hold cost and latency as product constraints, not afterthoughts.
- You operate autonomously on ambiguous problems. Given a rough product idea, a few customer quotes, and a Slack thread, you come back with a plan, a prototype, milestones, and a point of view on tradeoffs, without it being pre-scoped. You own high-technical-risk projects end-to-end.
- You contribute beyond your domain. As a senior IC, you go into whatever part of the codebase a problem requires, recognize issues beyond your immediate area, and translate between engineering goals and business objectives.
- You up-level the people around you. You mentor by pairing on hard problems, providing substantive design and code reviews, and spreading agent engineering literacy across the team. You see investing in your teammates' growth as part of the job.
- You're customer and product-driven. You're comfortable on customer calls and in feedback threads, you turn raw signals into requirements, scopes, and milestones, and you push back when feedback would lead the product astray.
- You're pragmatic, not a perfectionist. You ship the smallest correct thing, prefer robust solutions over complicated ones, and keep a high-quality bar with simplicity.
On the engineering fundamentals:
- You're a strong software engineer who can ship production services.
- You're comfortable across our stack - Go on the backend, TypeScript on the frontend, GraphQL, Postgres, Docker - or you're clearly able and eager to get there.
- You're fluent with agentic coding tools, and you understand and own every line it submits.
- You're comfortable in an async-first, multi-service, fast-paced remote environment.
Nice-to-haves:
- You've shipped an LLM-powered or agentic developer-facing product you can speak about opinionatedly: what worked, what didn't, what you'd do differently.
- You've built evaluation systems for LLM or ML products.
- You've fine-tuned, distilled, or trained models to meet cost, latency, or quality targets in production.
- Experience with retrieval, ranking, embeddings, or search relevance.
- Experience working directly with enterprise customers and translating their needs into a product.
- Experience mentoring or up-leveling engineers, especially raising a team's agent engineering fluency.
Level
📊 This job is an IC4. You can read more about our job leveling philosophy in our Handbook.
Compensation
💸 We pay above-market salaries because we want to hire exceptional people who can focus on building great products, not worrying about paying bills. As an open and transparent company, our compensation philosophy and pay bands are visible to every Sourcegraph teammate, and we strive to make our approach equitable, explainable, and competitive.
Your base salary is determined by the IC4 pay band for your location zone (1-4). Our pay bands are informed by market data and designed to ensure competitive compensation wherever you live. During the recruiting process, we'll discuss the range applicable to you based on job level, relevant skills, experience, qualifications, and location zone.
💰 The starting salary for the IC4 pay band in each zone is:
- Zone 2: $176,000 USD
- Zone 3: $132,000 USD
- Zone 4: $88,000 USD
📈 In addition to competitive cash compensation, we offer meaningful equity (because when Sourcegraph succeeds, we want you to succeed, too) and generous perks & benefits.
Interview process
Below is the interview process you can expect for this role (you can read more about the types of interviews in our Handbook). It may look like a lot of steps, but rest assured that we move quickly and the steps are designed to help you get the information needed to determine if we’re the right fit for you… Interviewing is a two-way street, after all!
We expect the interview process to take 4.75 hours in total.
👋 Introduction Stage - we have initial conversations to get to know you better…
- [30m] Recruiter Screen
- [45m] Hiring Manager Screen / Resume Deep Dive
🧑💻 Team Interview Stage - we then delve into your experience in more depth and introduce you to members of the team, including cross-functional partners…
- [60m] Technical Interview
- [60m] Technical Interview
- [60m] Cross-functional team collaboration / Values
🎉 Final Interview Stage - we move you to our final round, where you gain a better understanding of our business and values holistically…
- [30] Leadership
- We check references and conduct your background check
Please note - you are welcome to request additional conversations with anyone you would like to meet, but didn’t get to meet during the interview process.
What you'll do
- Design and harden multi-step, tool-using agent loops for current and new agentic experiences.
- Turn research and experiments into reliable, observable, and affordable enterprise-scale products.
- Apply pragmatic evaluations, targeted smoke tests, metrics, and judgment to determine whether product changes help.
- Decide which models to run where, drive model upgrades, and fine-tune models when appropriate.
- Improve retrieval and context engineering, including retrieval, ranking, context windows, and citations for customer code.
- Treat cost and latency as product features by profiling, distilling, caching, and right-sizing models.
- Talk to customers, frame problems, and own product work end-to-end.
- Get Code Understanding products and model/agent pipelines running locally.
- Land improvements to a model, prompt, retrieval path, or evaluation.
- Build a picture of AI engineering pain points and constrained product surfaces.
- Get to know the team and customers and form opinions about future agentic product direction.
- Join the team's on-call support rotation.
- Own a meaningful agentic slice of the product end-to-end from problem framing through rollout and measurement.
- Establish how the team ships model and prompt changes responsibly through evals, dashboards, and guardrails.
- Up-level teammates in building with models through pairing, code review, and modeling agent engineering instincts.
- Act as technical authority for agent engineering and agentic systems on Code Understanding.
- Improve product outcomes such as answer quality, cost, latency, or new agentic capabilities.
- Set roadmap direction where it intersects agents and pull other engineers up to execute.
What they require
- Senior engineer and technical leader with hard-won skills in agent engineering, blending software engineering, machine learning, and statistics.
- Ability to collaborate on steering technical direction and be a force multiplier for a product-minded team.
- Comfort reasoning about eval harnesses, fine-tuning runs, retrieval pipelines, and multi-step agent loops.
- Operate at staff scope by owning ambiguous, high-risk problems, working across codebases, setting standards, and translating between engineering goals and business objectives.
- Real agent engineering depth: built, trained, evaluated, and operated models in production.
- Thinks in terms of datasets, evals, baselines, metrics, and error analysis.
- Experience designing multi-step agentic systems and making them reliable, observable, and cost-bounded.
- Has a point of view on where agents shine and where deterministic code or human judgment is required.
- Pragmatic about evaluations and conscious of cost and latency constraints.
- Able to operate autonomously on ambiguous problems and produce plans, prototypes, milestones, and tradeoff analysis from rough product input.
- Owns high-technical-risk projects end-to-end.
- Contributes beyond immediate domain as a senior IC.
- Mentors through pairing, substantive design and code reviews, and spreading agent engineering literacy.
- Customer and product-driven; comfortable on customer calls and feedback threads.
- Able to turn raw signals into requirements, scopes, and milestones and push back on misleading feedback.
- Pragmatic, not a perfectionist; ships the smallest correct thing and prefers robust, simple solutions.
- Strong software engineer who can ship production services.
- Comfortable across the stack: Go on the backend, TypeScript on the frontend, GraphQL, Postgres, Docker, or clearly able and eager to get there.
- Fluent with agentic coding tools and understands and owns every line submitted by them.
- Comfortable in an async-first, multi-service, fast-paced remote environment.
- Must overlap with EST for at least 20 hours/week.
- Preferred: Shipped an LLM-powered or agentic developer-facing product and can discuss what worked, what did not, and what they would do differently.
- Preferred: Built evaluation systems for LLM or ML products.
- Preferred: Fine-tuned, distilled, or trained models to meet cost, latency, or quality targets in production.
- Preferred: Experience with retrieval, ranking, embeddings, or search relevance.
- Preferred: Experience working directly with enterprise customers and translating their needs into a product.
- Preferred: Experience mentoring or up-leveling engineers, especially raising a team's agent engineering fluency.
Benefits
- Above-market salaries.
- Transparent compensation philosophy and pay bands visible to every Sourcegraph teammate.
- Starting salary based on IC4 pay band for location zone.
- Meaningful equity.
- Generous perks and benefits.
- Globally distributed team.
- High agency.
- Direct communication.
- Customer love.
- Real agency over technical direction.
- Direct line to the impact of your work.
- Option to request additional conversations with anyone the candidate would like to meet during the interview process.
Sourcegraph brings clarity and control to complex codebases, giving engineering organizations visibility across their systems, context for AI agents, and the ability to execute coordinated code changes at scale. Its products include Code Search, Deep Search, MCP, and Agentic Batch Changes.