Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
McKessonPosted 20 days ago

Principal AI Engineer

Remote · US-eligiblePrincipalRemoteFull-time$195,000 – $325,000 a year
Who we'd reach at McKessonFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Team director

Heads the group this role sits in

Recruiter

In-house, owns the opening

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a full-time, remote principal AI engineering role at McKesson, open to US-eligible candidates, with the Columbus, Ohio area given priority. It suits senior engineers with more than a decade of software experience who already set technical direction across several teams. The job sets multi-year strategy for the company's AI platform, covering agentic and LLM systems, retrieval, connector ecosystems and evaluation tooling, and acts as the final technical escalation point. McKesson states it cannot offer visa sponsorship for this role now or in the future.

What you’ll do

  • Set the multi-year technical strategy and roadmap for the AI platform across every team that builds on it.
  • Act as the final escalation point for the hardest architecture and reliability problems that span several teams.
  • Define architecture, security and evaluation standards that multiple Lead AI Engineers adopt, and keep them current.
  • Advise VP and executive leaders on AI platform strategy, model risk and investment trade-offs.
  • Personally prototype and lead the highest-risk, most ambiguous AI initiatives.
  • Mentor Lead and Senior AI Engineers through design reviews and structured knowledge sharing.
  • Help shape enterprise AI governance policy with Legal, Compliance and Privacy leaders, including PHI-handling standards.
  • Evaluate foundation model providers and AI infrastructure vendors company-wide.
  • Represent the company's AI engineering work externally and help recruit senior technical talent.

What they’re looking for

  • Bachelor's degree or equivalent experience, with typically 12+ years of software engineering including 6+ years on AI/ML, LLM or NLP systems in production. Fewer years are accepted with a relevant Master's or Doctorate.
  • 3+ years as a senior individual-contributor technical leader setting direction across multiple teams.
  • A proven record of technical strategy that several teams adopt.
  • Hands-on experience building production LLM applications: prompt engineering, RAG, agentic workflows, tool use and evaluation harnesses.
  • Experience with commercial LLM APIs such as Anthropic or OpenAI, and tool-integration protocols such as Model Context Protocol.
  • Strong fundamentals in Python and/or Java, REST APIs, event-driven architecture, microservices and cloud-native design (Azure preferred, AWS or GCP acceptable).
  • Experience with vector and graph retrieval systems, embeddings and knowledge-base architecture at production scale.
  • Deep LLMOps or MLOps knowledge, including usage attribution, cost monitoring, abuse detection and evaluation pipelines.
  • Ability to influence senior engineering and executive stakeholders without direct authority.
  • Familiarity with regulated healthcare data and AI governance frameworks such as model risk review and PHI handling.

Nice to have

  • Master's or PhD in computer science, AI/ML or a related technical field.
  • Prior Principal, Staff or Distinguished Engineer experience setting AI strategy across teams in healthcare IT or another regulated industry.
  • Publications, patents, open-source work or industry speaking on applied AI.
  • Experience shaping enterprise AI governance policy with Legal, Compliance and Privacy.
  • Experience managing enterprise relationships with AI infrastructure and model vendors.
  • Ability to separate durable technical bets from hype.

What’s on offer

  • Base pay range of 195,000 to 325,000 USD per year.
  • Total rewards may include an annual bonus, long-term incentives and equity, depending on performance, experience, skills, geography and market evaluations.

Skills

Questions about this role

Is this role remote?

Yes. It is listed as remote and open to US-eligible candidates, with priority for people in the Columbus, Ohio area.

How much does it pay?

The base pay range is 195,000 to 325,000 USD per year, and bonus or long-term incentive opportunities may also be offered.

How many years of experience do I need?

Typically 12+ years of software engineering, including 6+ years on AI/ML systems in production and 3+ years as a senior individual contributor. A relevant Master's or Doctorate can reduce the years required.

Does McKesson sponsor visas for this role?

No. The posting says sponsorship is not available for this role, now or in the future.