Why logit distillation works: A novel knowledge distillation technique by deriving target augmentation and logits distortion.
Md. Imtiaz Hossain|Sharmen Akhter|Nosin Ibna Mahbub|Choong Seon Hong|Eui-Nam Huh
| Anthology ID: | DBLP:journals/ipm/HossainAMHH25 |
|---|---|
| Year: | 2025 |
| Venue: | Information Processing and Management |
| Pages: | 104056 |
| URL: | https://doi.org/10.1016/J.IPM.2024.104056 |
| DOI: | https://doi.org/10.1016/J.IPM.2024.104056 |
| DBLP: | journals/ipm/HossainAMHH25 |
| BibTeX: |
@article{hossain-2025-logit,
author = {Md. Imtiaz Hossain and
Sharmen Akhter and
Nosin Ibna Mahbub and
Choong Seon Hong and
Eui-Nam Huh},
title = {{Why logit distillation works: A novel knowledge distillation technique by deriving target augmentation and logits distortion}},
journal = {Information Processing and Management},
volume = {62},
number = {3},
pages = {104056},
year = {2025},
url = {https://doi.org/10.1016/J.IPM.2024.104056},
doi = {https://doi.org/10.1016/J.IPM.2024.104056}
}