Staff AI Engineer
Skills
About the role
This is an onsite Staff AI Engineer role at Gnani.ai in Bengaluru, owning the intelligence layer for the company's agentic voice and chat platform. You'd lead the orchestration, RAG, multi-agent and tool-calling systems that power real-time voice conversations, while also mentoring a small team of engineers. It suits a hands-on tech lead with several years of production LLM or agentic systems experience who wants to write code and lead at the same time.
What you’ll do
- Own the orchestration layer routing requests across LLMs with fallbacks, caching and cost/latency controls
- Build prompt management, structured output handling and tool-calling pipelines for real-time voice
- Own the end-to-end RAG stack, including ingestion, chunking, retrieval, re-ranking and grounding
- Design multi-agent architecture with planner-worker patterns and shared memory
- Design the tool-calling framework for CRM updates, ticket creation and payment flows
- Define evaluation gates with offline evals, golden test sets and LLM-as-judge pipelines
- Build observability for agent decisions with traces and quality dashboards
- Design guardrails against prompt injection and off-policy behavior
- Lead, mentor and grow a team of agentic AI engineers
What they’re looking for
- 7-12 years of experience, including 8+ years in software or ML engineering
- 2+ years building LLM-based or agentic systems in production
- Experience leading engineers as a tech lead or staff engineer
Nice to have
- Real-time or voice AI experience with latency-sensitive pipelines
- Streaming ASR/TTS integration
- Fine-tuning or serving small language models, vLLM, TensorRT-LLM
- Experience with Indic languages or code-mixed text
- Familiarity with data residency, DPDP or RBI compliance requirements
- Hands-on experience with LiveKit or Pipecat frameworks
What’s on offer
- Compensation in the range of roughly $56,600-$78,300 per year
- Onsite, in-office collaboration in Bengaluru
Questions about this role
Is this role remote?
No, it's onsite in Bengaluru with in-office collaboration.
How much does it pay?
Roughly $56,600-$78,300 per year, as listed on the posting.
How many years of experience do I need?
7-12 years overall, including at least 2 years building LLM-based or agentic systems in production.
Related roles
Solutions Engineer AI Engineer
Remote solutions engineering role in India for building conversational voice and video AI applications in life sciences. The role suits engineers with at least three years of Python, API, LLM, or AI solutions experience.
AI Engineer – Generative AI
Onsite AI Engineer role in Hyderabad, Ahmedabad, or Indore building generative-AI and agentic systems. The position suits an engineer with at least six years of experience across LLMs, RAG, Python, and cloud deployment.
Senior AI-Native Engineer
Senior hybrid AI engineering role in Gurgaon for an engineer with five or more years of experience and production AI/ML background. You'll design agentic applications, evaluation frameworks, and monitored AI capabilities end to end.
Senior AI-ML Engineer
A senior AI/ML engineering role at Ericsson in Bengaluru, building GenAI and machine learning capabilities across products and developer tooling.
Principal Engineer - Gen AI, LLM, RAG, Agentic AI
A principal engineering role at Wells Fargo in Bengaluru focused on GenAI, RAG and agentic AI architecture, evaluation and governance. Suited to a senior technical leader with deep GenAI stack and AI security expertise.
IN_Senior Associate_Azure AI/ML/Agentic AI Engineer_GCC_Advisory_Bangalore
An on-site Bengaluru role building agentic AI and RAG applications on the Azure AI stack at PwC's Advisory GCC. Suited to a Python engineer with 4-8 years of experience in Azure AI and agentic frameworks.