Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
PersonioPosted 2 days ago

Senior Deep Learning Software Engineer, LLM Performance

United StatesSeniorRemoteFull-time$184,000 – $356,500 an hour
Who we'd reach at PersonioFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Team director

Heads the group this role sits in

Recruiter

In-house, owns the opening

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a senior software role focused on speeding up large language model inference, serving and deployment on GPU hardware. It suits engineers with at least eight years of software development experience who are comfortable in Python, C or C++ and in deep learning frameworks. The work centres on performance tuning, benchmarking and contributing code to open-source and internal inference frameworks.

What you’ll do

  • Tune and analyse the performance of large language, vision-language and generative AI models for inference, serving and deployment.
  • Scale model performance across different architectures and accelerator types for throughput, latency and latency-constrained throughput.
  • Contribute features and code to open-source LLM frameworks, inference benchmarking tools, TensorRT and Triton.
  • Work with teams across generative AI, automotive, image understanding and speech understanding on new solutions.

What they’re looking for

  • A bachelor's, master's or PhD in computer engineering, computer science, EECS, AI or an equivalent background.
  • At least eight years of relevant software development experience.
  • Strong Python, C or C++ programming and solid software design skills.
  • Experience with a deep learning framework such as PyTorch, JAX or TensorFlow.

Nice to have

  • Prior work with an LLM framework or a deep learning compiler for inference, deployment or algorithms.
  • Experience profiling, debugging and optimising deep learning or high-performance computing applications.
  • Knowledge of CPU and GPU architecture.
  • GPU programming experience with CUDA or OpenCL.

What’s on offer

  • Base salary range of 184,000 to 287,500 USD for one level and 224,000 to 356,500 USD for another, set by location, experience and peer pay.
  • Eligibility for equity and benefits.

Skills

Questions about this role

How many years of experience do I need?

At least eight years of relevant software development experience is required.

Do I need a degree?

A bachelor's, master's or PhD in a relevant field is listed, or equivalent experience.

How much does it pay?

The base salary range is 184,000 to 287,500 USD for one level and 224,000 to 356,500 USD for another, plus equity and benefits.

Which programming languages are needed?

Strong Python, C or C++ programming skills are required.