Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
Salvo SoftwarePosted 9 days ago

Senior MLOps Engineer

Who we'd reach at Salvo SoftwareFound and reached by Power Apply
Best leadEngineering manager

Leads the team you would join

Technical recruiter

Owns the opening

Team member

On the team, can refer you

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a senior, hands-on MLOps engineering role that is remote and open worldwide, for an engineer who builds the path from model experiments to production for ML and LLM systems. The work covers training and fine-tuning pipelines, model registries, automated deployment, scalable inference and monitoring across cloud, on-prem and air-gapped environments. Salvo Software is a custom software and engineering firm with distributed teams across the US, LATAM and India, and this role sits within its growing AI department.

What you’ll do

  • Design, deploy and run MLOps platform infrastructure on AWS, Azure or GCP, including LLM inference with Ollama and vLLM.
  • Build CI/CD pipelines, infrastructure as code and monitoring for RAG applications, AI agents and production deployments.
  • Manage Linux servers, networking and security, and troubleshoot production issues alongside AI engineering teams.
  • Set department-wide MLOps and DevOps standards and reusable infrastructure templates.
  • Guide AI developers and RAG engineers on architecture, deployment strategy and tool selection.
  • Provision containers, servers and GPU hardware with Terraform and Ansible across cloud and on-prem environments.
  • Lead incident response and root cause analysis to keep operations resilient.
  • Maintain clear system documentation.

What they’re looking for

  • 5+ years of senior DevOps, SRE or platform engineering experience, with at least 1 year deploying ML models and LLM inference engines in production.
  • Proficiency with Linux, Docker, Kubernetes and virtualization such as Proxmox or VMware.
  • GPU infrastructure experience with CUDA and NVIDIA.
  • Experience with AWS, Azure and GCP.
  • Hands-on experience with Terraform, Ansible, GitHub Actions, Azure DevOps, Bash and Python.
  • Solid networking knowledge covering DNS, TLS, firewalls and VPNs.
  • Experience with monitoring, logging and security concepts such as OAuth2/OIDC, API gateways and Zero Trust or SOC 2.

Nice to have

  • Familiarity with MLflow or Kubeflow.
  • Familiarity with vector databases and RAG or agent frameworks such as MCP.
  • Familiarity with Airflow or Kafka.
  • Familiarity with model optimization and quantization.

What’s on offer

  • Full-time, remote position open worldwide.

Skills

Questions about this role

Is this role remote?

Yes, the listing is remote and open worldwide.

How many years of experience do I need?

The posting asks for 5+ years of senior-level experience.

Is this a full-time role?

Yes, it is listed as full-time.