Who we'd reach at Featherless AIFound and reached by Power Apply
Best leadHiring manager
Leads the team this role joins
Team lead
Runs the team day to day
Founder
Decides on early hires
From your own Gmail and LinkedIn.
About the role
This is a worldwide remote research role for someone focused on model distillation, shrinking large models into smaller, faster and more deployable systems without losing quality. The work moves ideas from research papers to production code and suits researchers with publications, including those coming from academia or industry labs.
What you’ll do
- Design and evaluate distillation methods such as teacher-student training, self-distillation, layer-wise distillation and representation matching.
- Study tradeoffs between model size, latency, memory and accuracy.
- Develop distillation approaches for large language models, long-context models and inference-constrained environments.
- Run large-scale experiments and ablations, and analyze the results rigorously.
- Work with engineers to turn research outcomes into production systems.
- Write and submit papers to top venues such as NeurIPS, ICML, ICLR and COLM, and contribute to internal notes, technical blogs and open-source projects.
What they’re looking for
- Strong background in machine learning research.
- Hands-on experience with distillation or related areas such as compression, pruning, quantization or representation learning.
- Publication record, including conference or journal papers, workshop papers or arXiv preprints.
- Solid grounding in deep learning fundamentals such as optimization, training dynamics and generalization.
- Fluency in PyTorch or an equivalent framework and research-grade experimentation.
- Ability to communicate research ideas, results and limitations clearly.
Nice to have
- Experience distilling large language models.
- Efficiency-focused research on latency, memory or throughput.
- Experience with long-context or non-Transformer architectures.
- Open-source contributions in machine learning or research tooling.
- Prior startup or applied research experience.
What’s on offer
- Worldwide remote work.
- Real ownership of research direction at a Series A stage company.
- Stated support for publishing and open research.
- Access to meaningful compute and production-scale problems.
Skills
Model DistillationModel CompressionPruningQuantizationPyTorchDeep LearningLarge Language ModelsMachine LearningA/B TestingRepresentation Learning
Questions about this role
Is this role remote?
Yes, the role is worldwide remote and open to applicants anywhere.
Do I need publications?
Publication experience is required, and this can include conference or journal papers, workshop papers or arXiv preprints.
Do I need a degree?
The listing asks for a degree or equivalent experience.