Who we'd reach at HiringBlazeFound and reached by Power Apply
Best leadHiring manager
Leads the team this role joins
Recruiter
In-house, owns the opening
Posted this job
Put the opening up
From your own Gmail and LinkedIn.
About the role
This is a full-time LLM and AI engineering role in Hyderabad for engineers with five to eight years of experience, at least five of them as an LLM or AI engineer. The job is hybrid, with three office days a week, and focuses on model selection, prompt engineering and retrieval-augmented generation for agentic AI products. The hiring team is prioritizing candidates who can join quickly.
What you’ll do
- Build and tune LLM pipelines using OpenAI, Anthropic, Llama and Mistral to find the best balance of cost and performance.
- Build and maintain RAG systems that give agents access to internal documentation, customer history and trading platform data.
- Develop and version prompt templates using few-shot and chain-of-thought techniques.
- Set up LLM-as-a-judge evaluation and automated tests for hallucination, toxicity and accuracy before release.
- Write tool-use logic so agents call APIs and databases reliably and safely.
- Reduce inference and retrieval latency.
- Monitor models in production for performance and drift using LLMOps tooling.
What they’re looking for
- Five to eight years of experience overall, with at least five years as an LLM or AI engineer.
- Strong RAG architecture experience.
- Hands-on experience with OpenAI, Anthropic, Llama and Mistral.
- Experience with model version tuning.
- DevOps skills.
- A Bachelor of Engineering or Bachelor of Technology degree.
- A notice period of immediate to 30 days. Longer notice periods are rejected automatically.
Nice to have
- Experience in high-throughput environments such as trading, fintech or global logistics.
- Experience building and deploying autonomous agents in production.
- Familiarity with Claude and the OpenClaw ecosystem.
What’s on offer
- Competitive compensation and professional growth opportunities.
- Work on modernizing legacy systems and shaping trading technology.
Skills
Retrieval-augmented generationLarge language modelsOpenAI APIAnthropic ClaudeLlamaMistralPrompt engineeringChain-of-thought promptingFew-shot promptingAgentic AILLMOpsDevOpsLLM evaluationLLM-as-a-judgeLatency optimization
Questions about this role
Is this job remote?
No. It is hybrid, with three days a week in the office.
What notice period is accepted?
Immediate joiners or up to 30 days. Longer notice periods are rejected automatically.
How many interview rounds are there?
Two to three technical rounds.
How many years of experience do I need?
Five to eight years, with at least five as an LLM or AI engineer.