Senior Software Engineer — Infra Agent Systems Remote India
Skills
About the role
Together AI is hiring a senior backend and infrastructure engineer in India for a remote role building AI agents that help operate GPU infrastructure. The position suits engineers with substantial production-systems experience who can build both operational agents and the platforms that support them. You’ll work on systems for incident investigation, hardware diagnosis, retrieval, orchestration, and automation used by infrastructure and datacenter teams. The role includes designing, running, observing, and improving services in production.
What you’ll do
- Build AI-driven systems for diagnosing and responding to infrastructure failures.
- Develop distributed services, retrieval capabilities, knowledge graphs, and agent orchestration.
- Connect agents with telemetry, inventory, incident, ticketing, source-control, and chat systems.
- Own services from architecture through production support.
- Use evaluation and production feedback to improve agent reliability.
What they’re looking for
- At least 5 years building backend, distributed, or infrastructure platforms.
- Strong system design and end-to-end ownership of production systems.
- Experience in agent systems, orchestration, knowledge graphs, or search and retrieval.
- Backend expertise covering APIs, data modeling, service boundaries, and complex integrations.
- Experience with Kubernetes, GitOps, infrastructure as code, and cloud platforms.
- Ability to work in Go, TypeScript, Python, Rust, or similar languages.
Nice to have
- Experience with GPU fleets, datacenters, bare metal, BMC/IPMI, or schedulers.
- Graph databases or event-driven messaging systems such as NATS or Kafka.
- Prometheus, Grafana, or LLM evaluation frameworks.
What’s on offer
- Remote work from India.
- A full-time engineering role.
Questions about this role
Is this role remote?
Yes. The role is remote and based in India.
How much experience is required?
The posting requires 5 or more years of relevant backend, distributed-systems, or infrastructure-platform experience.
What technologies are relevant?
The role mentions Kubernetes, GitOps, cloud platforms, Go, TypeScript, Python, Rust, retrieval systems, and knowledge graphs.
Related roles
Senior Software Engineer - DevOps Engineer
A senior DevOps engineering role at Wells Fargo in Bengaluru, building CI/CD pipelines and driving automation.
Software Engineering Senior Manager - Data Engineering - GEN AI
A senior engineering management role leading data engineering teams for Wells Fargo's Treasury Technology group in Bengaluru. Suited to an experienced people leader with a data engineering background in regulated financial services.
Senior Software Engineer (Python, AI ML Engineer)
Optum is hiring a senior software engineer in Gurugram to build and operate AI, ML, and LLM-powered enterprise solutions. The role suits engineers with production AI experience, Python or similar software skills, and knowledge of RAG, orchestration, cloud services, and evaluation.
Senior Software Engineer-Python,spark,Iceberg,Hive
A senior software engineering role at Wells Fargo in Hyderabad, modernizing large-scale data platforms with Python, Spark, Iceberg, and Hive.
Software Development Engineer, Amazon Traffic Engineering
A software development engineer role at Amazon in Hyderabad, building service onboarding and tax-compliance systems at scale.
Senior Software Engineer (AI & Data)
Senior AI and data software engineer role in Bengaluru focused on production data platforms, analytics infrastructure and agent orchestration. The role suits engineers with four or more years of relevant experience who value reliable and auditable systems.