Перейти к основному содержимому
Fello

Prompt Engineer, Multi-Agent Systems

УдалённоIndia только
Опубликовано
Роль
AI / ML
Размер компании
Стартап
Зарплата не указана
Проверьте доступность

Доступно для: IN only. Укажите, откуда вы работаете, чтобы проверить доступность.

Коротко по делу

Seeking a Prompt Engineer with production LLM experience and a systems thinking approach to design and evaluate multi-agent systems. Must have experience with evaluation, observability tooling, and multi-step architectures. Strong writing skills are essential as you'll craft customer-facing agent text.

Ключевые навыки

Multi-Agent SystemsPrompt EngineeringLLM Evaluation

Обязательные навыки

LLMsevaluation toolingtracingprompt versioningdatasetsexperiment runsmulti-step architecturesmulti-agent architecturestool callingfunction callingstructured outputshandoffs between agentsvoice agentsprompt templatingconditional logic

Желательные навыки

open-weight modelsregulated or compliance-sensitive domainreal estatesales techhigh-volume outbound

Обязательные языки

English

Чем предстоит заниматься

  • Design prompts for agents that work together.
  • Define what each agent knows, what it's allowed to decide, what it hands off, and what it must never do, including the contracts between agents that keep the system coherent end to end.
  • Build the evaluation layer. Every prompt you ship comes with a dataset and a regression suite.
  • Curate test cases from real production behavior, write evaluator prompts, define scoring rubrics that actually track business outcomes, and catch regressions before customers do.
  • Make the system observable. Tracing, prompt versioning, datasets, experiments, scoring.
  • Instrument what isn't yet instrumented and use the data to find where agents are actually struggling, which is often somewhere other than where we'd guess.
  • Debug production behavior. When something goes wrong in a live interaction, you'll pull the trace, isolate the root cause, ship the fix, and add the case to the eval set so it never returns.
  • Work across different models. We use more than one model, because different jobs call for different tradeoffs in reasoning, speed, and cost. Each one follows instructions a little differently, so a prompt that works well on one may need real rework on another.
  • Help choose which model fits which job, and keep agent behavior stable when we switch.
  • Work with dynamic context. Our prompts are assembled at runtime from live data.
  • Design the logic that decides what an agent sees and when, and you'll find that many "prompt problems" turn out to be context problems.
  • Partner across the company. Product, engineering, sales, and support.
  • Turn a vague "this interaction felt off" into a reproducible test case, a fix, and a metric that proves it's fixed.

Что требуется

  • Hands-on experience building with LLMs in production, on systems that real users depend on day to day.
  • Real evaluation experience: building datasets, writing evaluator prompts, defining rubrics, running experiments, interpreting results, and acting on them.
  • Fluency with LLM observability and evaluation tooling: tracing, prompt versioning, datasets, experiment runs.
  • The specific tool matters less to us than the habits.
  • Experience with multi-step or multi-agent architectures: orchestration, tool and function calling, structured outputs, handoffs between agents.
  • Experience designing or debugging voice agents, including latency budgets, turn-taking, and the constraints of real-time speech.
  • Voice is a significant part of what we build.
  • Comfort with prompt templating and conditional logic, and with treating prompts as versioned, reviewable artifacts.
  • Systems thinking. You can hold a chain of agents in your head and reason about where a failure originated.
  • Strong writing. Every word an agent says to a customer is a word you wrote.

Преимущества

  • Competitive Compensation: Attractive salary and benefits package.
  • Flexible Work Environment: Fully remote work with flexible hours to promote work-life balance.
  • Professional Growth: Opportunities for career advancement and professional development.
  • Health & Wellness: Comprehensive health and vision insurance plans.
  • Paid Time Off: Generous PTO and paid holidays to recharge and relax.
  • Collaborative Culture: A supportive team environment that values innovation and collaboration.
  • Equity Options: Opportunity to own a part of Fello and share in our success.
  • Cutting-Edge Projects: Work on innovative products that leverage AI and advanced technologies.

program which recognizes scientists, engineers and innovators who have been recognized for their achievements across disciplines by the American Association for the Advancement of Science

Real EstateСтартапaaas.org/fellows/listing
Зарплата не указана