Own and build production AI/LLM applications end-to-end: architect RAG and agentic systems, implement function/tool calling, optimise inference costs, run evaluation frameworks, deploy on Kubernetes, and integrate with third-party platforms while collaborating with product teams to improve quality, latency, and cost.
Role Summary
We are looking for a Senior FullStack Engineer, AI to own and evolve Delta Exchange's suite of AI-powered products. You will work across multiple production AI applications: conversational support agents, RAG-powered search, code-generation copilots, and trading-strategy assistants. This is a hands-on role where you architect solutions around our existing stack, build retrieval pipelines, improve frontends with product sense, optimise inference costs, and run evaluations, collaborating closely with the product team.
Key Responsibilities
- Design, build, and maintain production AI applications end-to-end: backend, frontend, and inference services.
- Architect RAG systems using vector databases, embedding models, and chunking strategies optimised for accuracy and latency.
- Build agentic workflows with tool/function calling, multi-step reasoning, and structured output parsing, with accuracy and control as priority.
- Write and iterate on system prompts, few-shot examples, and prompt chains to maximise output quality.
- Implement function calling, tool-use patterns, and structured JSON/XML output handling using frontier and lightweight models from providers like Anthropic and OpenAI.
- Drive cost optimisation: model selection, caching, token budgeting, and request batching at scale.
- Build and maintain evaluation frameworks to measure accuracy, relevance, hallucination rates, and regression across prompt and model changes. Experience with observability tools (Sentry, Opik, etc.) is a must.
- Work with message queues (RabbitMQ), caching layers (Redis), and relational databases (PostgreSQL) powering AI service backends.
- Deploy and manage AI services on Kubernetes with CI/CD pipelines on AWS/GCP.
- Integrate AI capabilities with third-party platforms (Telegram bots, chat widgets, etc.).
- Contribute to architectural decisions: model selection, hosting (cloud APIs vs. self-hosted), and build-vs-buy trade-offs.
Required Skills & Experience
- 5+ years shipping production software systems.
- 2 years building AI/LLM-powered applications end-to-end with real users and volume. Not prototypes.
- Strong experience with RAG architectures: vector databases, embedding models, chunking/indexing strategies, and retrieval evaluation.
- Deep understanding of LLM capabilities and limitations: prompt engineering, function/tool calling, structured outputs, context window management, and multi-turn conversations.
- Experience with LLM provider APIs and abstraction layers (OpenAI, Anthropic, LiteLLM, OpenRouter, or similar).
- Proficiency in Python (Flask/FastAPI) and/or Node.js/TypeScript (Next.js, Vercel AI SDK). Golang experience is a plus.
- Hands-on experience building evals, tracking quality metrics, and debugging non-deterministic outputs in production.
- Familiarity with cost optimisation: model routing, caching, token usage monitoring, and prompt compression.
- Solid fundamentals in data structures, algorithms, and system design.
- Experience with containerised deployments (Docker, Kubernetes) and cloud platforms (AWS/GCP). Practical understanding of k8s concepts and trade-offs is a must.
Nice to Have
- Experience with agentic frameworks (Vercel AI SDK, LangChain, Mastra, etc.). Even better if you have built Gen AI apps using raw HTTP calls to provider APIs and designed efficient conversation persistence to a database.
- Background in fine-tuning or training open-source models. Huge plus if you can demonstrate matching proprietary model quality (Sonnet 4.6, Haiku 4.5, etc.) with fine-tuned alternatives.
- Knowledge of cryptocurrency, derivatives trading, or financial systems. Helps understand how AI can improve product UX.
- Open-source contributions or personal projects with real traction. Even a tool you built to solve your own problem counts.
- Your day is spent mostly in AI coding harnesses (Claude Code, Codex, Droid, etc.), MCP servers, custom skills, and similar tooling. We use AI to build AI, and candidates already living this workflow will ramp up fast.
- Proven ability to debug production AI systems: diagnosing tool call failures, optimising function calling patterns, refining prompts and tool descriptions under real traffic.
- Extreme ownership and bias towards action. You treat production AI systems as your own, proactively improving quality, latency, and cost without waiting to be asked. You deliver your best work especially when no one is watching.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Develop AI products using Python, Spring/Java, React, Azure, and Optum AI platforms. Lead a team of engineers delivering AI solutions, support production deployments, and apply expertise in AI, cloud, frontend, backend, and database technologies. The role requires a graduate degree or equivalent experience, at least nine years of relevant experience, and advanced knowledge of Azure, React, Java, Oracle, and MySQL. Relevant technology certifications are preferred.
Top Skills:
JavaAzureMySQLOptum AiOraclePythonReactSpring
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Build end-to-end full-stack AI features on a Ruby on Rails backend and React frontend, including LLM inference infrastructure, RAG, AI agents, and evaluation/observability. Design and run experiments (A/B tests), optimize systems for production performance and reliability, and iterate rapidly with product and design partners.
Top Skills:
A/B TestingAi AgentsLlmsMySQLPostgresReactRetrieval-Augmented Generation (Rag)RubyRuby On Rails
Consumer Web • Edtech • Enterprise Web • Social Impact
Build and deploy AI-powered solutions for enterprise and campus customers. Scope customer environments, prototype agentic AI solutions, design secure multi-tenant and hybrid architectures, and harden validated prototypes into production. Own identity, encryption, networking, CI/CD, observability, and production support for customer deployments. Partner with executives, product managers, AI specialists, analysts, and engineers while identifying reusable patterns and informing product strategy. Regular travel supports discovery, workshops, prototyping, executive readouts, and go-live engagements.
Top Skills:
Api GatewaysAWSCi/CdDockerDuckdbEncryption And Key ManagementFastmcpIamJavaKafkaKubernetesLangchainLanggraphMcpMtlsObservabilityPgvectorPostgresPrivatelinkPythonRagTypescriptVpc Peering
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
