Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
Together AIPosted 19 days ago

Senior Software Engineer — Infra Agent Systems Remote India

Who we'd reach at Together AIFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Recruiter

In-house, owns the opening

Posted this job

Put the opening up

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a senior software engineering role at Together AI, fully remote from India, for engineers with at least 5 years of production backend or infrastructure experience. The team builds production AI agents that diagnose hardware failures and investigate incidents across a large GPU fleet, along with the knowledge graph, retrieval and orchestration platform those agents run on. Engineers own services end to end, from design through production operations and feedback loops.

What you’ll do

  • Design and build production AI agents that diagnose, investigate and help remediate infrastructure issues.
  • Build distributed services, orchestration, knowledge graph and retrieval systems that power the agents.
  • Develop fleet intelligence that combines telemetry, infrastructure state, operational knowledge and incident history.
  • Integrate with observability, incident, ticketing, inventory, source control, chat and internal systems through APIs.
  • Own services end to end, including architecture, testing, deployment, observability and production operations.
  • Improve agent quality through evaluations, retrieval work, better tools and production feedback.
  • Turn lessons learned in production into reviewed software and automation.

What they’re looking for

  • 5+ years of building production backend, distributed or infrastructure systems.
  • Strong systems design skills and experience owning significant systems from design to production.
  • Depth in at least one of: AI agent systems, orchestration, tool use, evaluation or grounding.
  • Knowledge graph or graph data modeling experience.
  • Experience with search, retrieval, ranking, RAG or semantic search systems.
  • Strong backend skills in API design, service boundaries, data modeling and cross-system integrations.
  • Experience with Kubernetes, GitOps such as ArgoCD, infrastructure as code and cloud platforms.
  • Comfort working in at least one of Go, TypeScript, Python or Rust.

Nice to have

  • GPU infrastructure, datacenter, bare-metal, hardware failure mode, BMC/IPMI or cluster scheduler experience.
  • Graph database experience.
  • Event-driven systems and messaging platforms such as NATS or Kafka.
  • Observability with Prometheus and Grafana.
  • Building LLM evaluation frameworks or improving the reliability of LLM-powered systems.

What’s on offer

  • Remote role based in India.
  • Full-time position.
  • Opportunity to build foundational systems and work on infrastructure at large scale.

Skills

Questions about this role

Is this role remote?

Yes. It is remote and based in India.

How many years of experience are needed?

At least 5 years of production backend, distributed systems or infrastructure experience.

Is there a limit on applications?

Yes. Candidates may apply to up to 6 roles within a 90-day period, and applications beyond that limit are automatically rejected.

Which languages does the team use?

The posting mentions Go, TypeScript, Python and Rust.