Applied AI Engineer, Inference
Skills
About the role
This is an applied AI engineering role for someone with at least 4 years of machine-learning, systems or performance-engineering experience, based in Bellevue, San Francisco or Sunnyvale. You’ll measure and improve production inference performance through benchmarks, profiling, experiments and targeted optimisations. The role focuses initially on practical serving performance for customer and platform workloads, with scope expected to expand over time.
What you’ll do
- Build benchmarking workflows for latency, throughput, quality and cost.
- Compare inference performance against realistic workloads and external provider baselines.
- Profile serving behaviour across frameworks, runtimes and hardware.
- Identify bottlenecks involving prefill, decoding, KV caches, batching, graph capture and quantisation.
- Tune serving configurations and evaluate inference features for specific workloads.
- Run experiments involving quantisation, speculative decoding, caching and routing.
- Partner with platform engineers to move improvements into production.
- Write clear recommendations about models, runtimes, hardware and deployment strategies.
What they’re looking for
- At least 4 years of relevant experience in machine learning, systems, performance engineering or adjacent applied engineering.
- Strong Python programming skills in production environments.
- Experience running empirical evaluations, benchmarks or experiments.
- Understanding of latency, throughput, batching, GPU use, quantisation and quality regression trade-offs.
- Ability to work across model, systems and product teams.
- Clear technical communication and reproducible engineering practices.
Nice to have
- Experience with vLLM, SGLang, TensorRT-LLM or comparable serving stacks.
- Experience optimising inference on modern GPUs.
- Familiarity with Nsight Systems, PyTorch profilers or custom telemetry.
- Experience with coding, reasoning or agent benchmark suites.
- Experience using production traces or customer traffic patterns.
What’s on offer
- Full-time employment.
- Base salary of $188,000–$275,000 per year.
- Discretionary bonus, equity awards and benefits subject to eligibility.
- Medical, dental and vision coverage are fully paid by CoreWeave for US-based full-time employees.
- The role is listed in Bellevue, San Francisco and Sunnyvale.
Questions about this role
Where can this role be based?
The posting lists Bellevue, San Francisco and Sunnyvale.
How many years of experience are required?
The posting asks for 4 or more years of relevant experience.
What is the salary range?
The base salary is $188,000–$275,000 per year.
Which programming language is required?
Strong Python programming skills are required.
Related roles
Senior Manager, SOX-Business Process
Senior SOX business-process role in Bellevue for an accounting, finance or controls professional with at least 8 years of experience. The position leads control design, testing, remediation and financial-reporting compliance.
Senior Manager, Operations Communications
On-site Senior Manager role in Bellevue leading executive and internal communications for CoreWeave's operations organization.
Senior Manager, Operations Accounting - Fixed Assets
Senior fixed-asset accounting manager role in Dallas overseeing close, reporting, controls, audits, and a global data-center asset portfolio. The role suits an accounting leader with at least six years of experience and a professional accounting qualification.
Senior Manager, Operations Accounting Data Center Infrastructure
Senior onsite accounting leadership role in Dallas focused on financial governance for large-scale data center infrastructure construction. The role requires at least seven years of accounting experience and covers CapEx, CIP, fixed assets, SOX controls, and audit readiness.
Senior Manager, Joint Venture & VIE
CoreWeave is hiring a Senior Manager for Joint Venture and VIE Accounting in New York, Sunnyvale, or Dallas. The role requires a CPA and seven or more years of accounting experience, including hands-on ASC 810, ASC 323, and JV reporting work.
Senior Firmware Engineer, FPGA
Senior firmware and FPGA engineering role in New York or Sunnyvale focused on integrating platform logic with BMC, BIOS and server hardware. It suits an experienced RTL and low-level software engineer who can handle board bring-up and cross-layer debugging.