LLM Platform Engineer/Lead
Skills
About the role
This is a remote LLM platform engineering and technical-lead role open from EMEA or Bangalore. You'll create shared AI frameworks, SDKs, workflows, and operating practices that help teams ship reliable AI features without building every integration from scratch. The role is aimed at a senior engineer with production LLM experience and strong Python, platform, and systems-design skills.
What you’ll do
- Build internal AI frameworks, SDKs, and shared libraries.
- Define reusable patterns for LLMs, embeddings, agents, and workflows.
- Create tooling for prompt management, evaluation, observability, safety, cost control, and reliability.
- Help teams adopt AI through documentation, examples, and hands-on guidance.
- Prototype AI features and turn successful approaches into shared building blocks.
- Own AI tooling from experimentation through production.
What they’re looking for
- Hands-on experience with LLM APIs such as OpenAI or Anthropic.
- Experience with RAG, embeddings, and vector databases.
- Knowledge of prompt engineering, versioning, evaluation, and orchestration frameworks.
- Understanding of AI observability, cost monitoring, and failure modes.
- At least one LLM-powered production feature shipped and improved using telemetry or feedback.
- Comfort with vector search, tokenization, fine-tuning, and evaluation methods.
- Experience with data lakes, warehouses, feature stores, ETL, and cloud platforms.
- Excellent Python skills and experience building platforms or developer tooling.
- Strong API, service-design, and systems-design fundamentals.
- Ability to turn complex AI capabilities into simple reusable abstractions.
Nice to have
- Experience with agent systems and tool calling.
- Experience with guardrails, moderation, or safety checks.
- Familiarity with Docker, cloud infrastructure, and CI/CD.
- Previous work on a platform or enablement team.
What’s on offer
- Remote work from EMEA or Bangalore.
- Direct reporting to the co-founder and CTO.
- A visible role with access to company leadership.
- $500 home-office setup budget.
- $1,000 annual learning and development budget.
- Flexible work-from-home arrangement.
Questions about this role
Is the LLM platform role remote?
Yes. The posting says it can be performed remotely from EMEA or Bangalore.
What experience is required?
The posting requires production LLM experience, including at least one LLM-powered feature shipped and iterated using telemetry or user feedback.
Does this role focus on model research?
No. The posting emphasizes platform tooling, developer velocity, reuse, and production readiness rather than heavy model training or academic optimization.
What are the home-office and learning budgets?
The offer includes a $500 home-office setup budget and a $1,000 annual learning and development budget.
Related roles
senior ai engineer (m/f/d)
Kayzen is hiring a senior AI engineer for a remote role focused on production LLM functions, retrieval systems, agents, APIs, and cloud services. The position fits engineers with practical experience launching and operating AI capabilities.
Lead Data Platform Engineer
A remote lead data platform engineering role at Beyond Finance, owning ETL/reverse-ETL pipelines and production datastores.
Lead Engineer - AI Engineering
Lead AI Engineer role in Bengaluru for an AI engineer with a master's degree and at least 3 years of experience building agentic and generative AI systems. The role covers multi-agent architecture, enterprise integration, production deployment, evaluation, and safety.
Shiprocket - Senior Engineering Leader
An in-office senior engineering leadership role at Shiprocket in Gurgaon, owning platform architecture and scaling the engineering organization.
Engineering Lead
A remote engineering lead role at Pidge, a last-mile logistics platform, owning core platform architecture.
Software Engineering Lead-Java, SpringBoot, React.JS, Cloud, SQL
A full-stack software engineering lead role at Optum/UnitedHealth Group in Hyderabad, combining Java/React.js architecture with practical Generative AI integration and team mentorship.