Leads the team this role joins
In-house, owns the opening
Director or head of the group
From your own Gmail and LinkedIn.
About the role
This is a full-time remote role for a mid-level AI developer who builds and runs LLM-powered systems, open to candidates anywhere in the world. It suits a production-minded Python engineer with 3-5 years of experience who learns quickly, since deep machine learning research is not required. The hire supports the growing AI department at Salvo Software, a custom software company with distributed teams across the US, Latin America and India. Core work is serving open-source models, building retrieval pipelines and connecting models to tools, supported by DevOps and cloud work.
What you’ll do
- Serve and operate open-source LLMs with Ollama and llama.cpp, locally and in on-premises environments.
- Build and maintain RAG pipelines covering embeddings, vector databases, chunking and retrieval quality.
- Develop MCP integrations that connect language models to internal tools and data sources.
- Write Python backend services that power model inference and AI-driven product features.
- Process structured and semi-structured inputs such as XML, XSD and Office document formats.
- Build and maintain CI/CD pipelines and Docker-based deployments for AI services on Azure and AWS.
- Support event-driven pipelines using Apache Kafka producers and consumers.
- Over time, take on quantization, GPU and CUDA tuning, and offline or air-gapped deployments.
What they’re looking for
- 3-5 or more years of engineering experience, including production Python for real services, LLM inference, RAG or automation.
- Hands-on work serving models with Ollama or llama.cpp, implementing vector retrieval and developing MCP integrations.
- Cloud and infrastructure experience with Azure or AWS, Docker, Linux or Windows administration and CI/CD tooling such as Azure DevOps, GitHub Actions or GitLab CI.
- Working knowledge of DevOps, security and operations practice, including Git workflows, scripting, observability and compliance frameworks.
- Root-cause troubleshooting, self-directed learning, strong ownership and clear communication in remote teams.
Nice to have
- GPU and CUDA tuning, and model quantization.
- Terraform, Kubernetes, Kafka, or systems languages such as Go, Rust or C++.
What’s on offer
- Full-time, remote, open worldwide.
- Mentorship as you ramp up in areas such as RAG architecture, Kafka and advanced MCP work.
Skills
Questions about this role
Can I work from anywhere?
The role is listed as remote and worldwide.
How much experience is needed?
The posting asks for 3-5 or more years of engineering experience.
Do I need machine learning research experience?
No. The posting says you do not need to be a deep ML researcher. Production Python and fast learning matter more.
Is mentorship available?
Yes. Mentorship is offered as you ramp up in RAG architecture, Kafka and advanced MCP work.