Leads the team this role joins
Heads the group this role sits in
In-house, owns the opening
From your own Gmail and LinkedIn.
About the role
This is a senior software role focused on speeding up large language model inference, serving and deployment on GPU hardware. It suits engineers with at least eight years of software development experience who are comfortable in Python, C or C++ and in deep learning frameworks. The work centres on performance tuning, benchmarking and contributing code to open-source and internal inference frameworks.
What you’ll do
- Tune and analyse the performance of large language, vision-language and generative AI models for inference, serving and deployment.
- Scale model performance across different architectures and accelerator types for throughput, latency and latency-constrained throughput.
- Contribute features and code to open-source LLM frameworks, inference benchmarking tools, TensorRT and Triton.
- Work with teams across generative AI, automotive, image understanding and speech understanding on new solutions.
What they’re looking for
- A bachelor's, master's or PhD in computer engineering, computer science, EECS, AI or an equivalent background.
- At least eight years of relevant software development experience.
- Strong Python, C or C++ programming and solid software design skills.
- Experience with a deep learning framework such as PyTorch, JAX or TensorFlow.
Nice to have
- Prior work with an LLM framework or a deep learning compiler for inference, deployment or algorithms.
- Experience profiling, debugging and optimising deep learning or high-performance computing applications.
- Knowledge of CPU and GPU architecture.
- GPU programming experience with CUDA or OpenCL.
What’s on offer
- Base salary range of 184,000 to 287,500 USD for one level and 224,000 to 356,500 USD for another, set by location, experience and peer pay.
- Eligibility for equity and benefits.
Skills
Questions about this role
How many years of experience do I need?
At least eight years of relevant software development experience is required.
Do I need a degree?
A bachelor's, master's or PhD in a relevant field is listed, or equivalent experience.
How much does it pay?
The base salary range is 184,000 to 287,500 USD for one level and 224,000 to 356,500 USD for another, plus equity and benefits.
Which programming languages are needed?
Strong Python, C or C++ programming skills are required.