Leads the team this role joins
In-house, owns the opening
Director or head of the group
From your own Gmail and LinkedIn.
About the role
This is a senior, full-time engineering role on CoreWeave's Kubernetes-native inference platform, listed for Sunnyvale and Bellevue, with a fully remote arrangement stated. The engineer leads design and raises reliability and performance across several inference services. The role suits engineers with three to eight years of distributed systems or cloud experience who want to own latency, throughput, and reliability work.
What you’ll do
- Lead design reviews and drive architecture within the team.
- Define and own SLIs and SLOs, and make sure post-incident actions land.
- Implement inference optimisations such as micro-batch scheduling, speculative decoding, and KV-cache reuse.
- Strengthen incident posture through capacity planning, autoscaling, and rollback strategies.
- Mentor IC1 and IC2 engineers and review cross-team designs.
- At IC4, own an area spanning several services, such as request routing or GPU resource isolation.
What they’re looking for
- 3-5 years of experience for IC3, or 5-8 years for IC4, building distributed systems or cloud services.
- Strong coding in Python or Go, with C++ an advantage.
- Hands-on Kubernetes experience at production scale, with CI/CD and observability stacks such as Prometheus, Grafana, and OpenTelemetry.
- Practical knowledge of inference internals, including batching, caching, mixed precision, and streaming.
- A track record of improving P95 and P99 latency and service reliability.
- A Bachelor's or Master's in Computer Science or a related field, or equivalent practical experience.
Nice to have
- Contributions to inference frameworks such as vLLM, Triton, TensorRT-LLM, Ray Serve, or TorchServe.
- Experience with CUDA kernels, NCCL, RDMA, or GPU interconnect topologies.
- Experience leading multi-team initiatives or working with customers on critical launches.
What’s on offer
- Base salary of $182,000 to $242,000, with discretionary bonus and equity eligibility.
- US full-time benefits: medical, dental, and vision paid 100% by the company, life and disability insurance, FSA and HSA, tuition reimbursement, ESPP, mental wellness support, family-forming support, paid parental leave, childcare support, 401(k) with employer match, and flexible PTO.
- Catered lunch each day in office and data centre locations.
Skills
Questions about this role
Is this role remote?
The listing says fully remote, with locations in Sunnyvale and Bellevue.
How much does this role pay?
The base salary range is $182,000 to $242,000, plus a discretionary bonus and equity.
How many years of experience do I need?
3-5 years for IC3 or 5-8 years for IC4, building distributed systems or cloud services.
Do I need a degree?
A Bachelor's or Master's in Computer Science or a related field is listed, or equivalent practical experience.