Teaching Small AI Models to Learn From Their Own Mistakes
A survey by Mingyang Song and Mao Zheng maps the scattered literature on on-policy distillation, where a small model learns from its own mistakes.
- Source
- AlphaSignal
- Published
- Type
- news
- Read
- 1 min read
A survey by Mingyang Song and Mao Zheng maps the scattered literature on on-policy distillation, where a small model learns from its own mistakes.
Summarized by Atlas from AlphaSignal. Rights remain with the original publisher.
Read original report