Skip to main content
Delta Exchange

Senior Engineer AI

RemoteIndia only
Published
Role
Fullstack
Experience
Senior
Salary not disclosed
Check eligibility

Open to IN only. Set where you work from to check your eligibility.

No BS summary

Senior full-stack/AI engineer with 5+ years shipping production software and 2 years building real AI/LLM apps. Must handle RAG, LLM APIs, Python or Node/TypeScript, Docker/Kubernetes, AWS/GCP, observability, queues/caches/databases, and production evals. India-based role for someone comfortable owning AI products end-to-end.

Core skills

RAGPython/Node.jsLLM APIs

Required skills

Vector databasesEmbedding modelsPrompt engineeringFunction callingTool callingStructured outputsOpenAI/Anthropic/LiteLLM/OpenRouterFlask/FastAPITypeScriptNext.js/Vercel AI SDKDockerKubernetesAWS/GCPSentry/OpikRabbitMQRedisPostgreSQL

Optional skills

GoVercel AI SDKLangChainMastraHTTPOpen-source modelsClaude CodeCodex

What you'll do

  • Design, build, and maintain production AI applications end-to-end: backend, frontend, and inference services.
  • Architect RAG systems using vector databases, embedding models, and chunking strategies optimised for accuracy and latency.
  • Build agentic workflows with tool/function calling, multi-step reasoning, and structured output parsing, with accuracy and control as priority.
  • Write and iterate on system prompts, few-shot examples, and prompt chains to maximise output quality.
  • Implement function calling, tool-use patterns, and structured JSON/XML output handling using frontier and lightweight models from providers like Anthropic and OpenAI.
  • Drive cost optimisation: model selection, caching, token budgeting, and request batching at scale.
  • Build and maintain evaluation frameworks to measure accuracy, relevance, hallucination rates, and regression across prompt and model changes.
  • Work with message queues (RabbitMQ), caching layers (Redis), and relational databases (PostgreSQL) powering AI service backends.
  • Deploy and manage AI services on Kubernetes with CI/CD pipelines on AWS/GCP.
  • Integrate AI capabilities with third-party platforms (Telegram bots, chat widgets, etc.).
  • Contribute to architectural decisions: model selection, hosting (cloud APIs vs. self-hosted), and build-vs-buy trade-offs.

What they require

  • 5+ years shipping production software systems.
  • 2 years building AI/LLM-powered applications end-to-end with real users and volume. Not prototypes.
  • Strong experience with RAG architectures: vector databases, embedding models, chunking/indexing strategies, and retrieval evaluation.
  • Deep understanding of LLM capabilities and limitations: prompt engineering, function/tool calling, structured outputs, context window management, and multi-turn conversations.
  • Experience with LLM provider APIs and abstraction layers (OpenAI, Anthropic, LiteLLM, OpenRouter, or similar).
  • Proficiency in Python (Flask/FastAPI) and/or Node.js/TypeScript (Next.js, Vercel AI SDK).
  • Hands-on experience building evals, tracking quality metrics, and debugging non-deterministic outputs in production.
  • Familiarity with cost optimisation: model routing, caching, token usage monitoring, and prompt compression.
  • Solid fundamentals in data structures, algorithms, and system design.
  • Experience with containerised deployments (Docker, Kubernetes) and cloud platforms (AWS/GCP).
  • Practical understanding of k8s concepts and trade-offs is a must.
  • Experience with observability tools (Sentry, Opik, etc.) is a must.
  • Preferred: Golang experience is a plus.
  • Preferred: Experience with agentic frameworks (Vercel AI SDK, LangChain, Mastra, etc.).
  • Preferred: Even better if you have built Gen AI apps using raw HTTP calls to provider APIs and designed efficient conversation persistence to a database.
  • Preferred: Background in fine-tuning or training open-source models.
  • Preferred: Huge plus if you can demonstrate matching proprietary model quality (Sonnet 4.6, Haiku 4.5, etc.) with fine-tuned alternatives.
  • Preferred: Knowledge of cryptocurrency, derivatives trading, or financial systems. Helps understand how AI can improve product UX.
  • Preferred: Open-source contributions or personal projects with real traction. Even a tool you built to solve your own problem counts.
  • Preferred: Your day is spent mostly in AI coding harnesses (Claude Code, Codex, Droid, etc.), MCP servers, custom skills, and similar tooling.
  • Preferred: Proven ability to debug production AI systems: diagnosing tool call failures, optimising function calling patterns, refining prompts and tool descriptions under real traffic.
  • Preferred: Extreme ownership and bias towards action. You treat production AI systems as your own, proactively improving quality, latency, and cost without waiting to be asked.
  • Preferred: You deliver your best work especially when no one is watching.
Crypto
Salary not disclosed