Why logit distillation works: A novel knowledge distillation technique by deriving target augmentation and logits distortion.

Md. Imtiaz Hossain|Sharmen Akhter|Nosin Ibna Mahbub|Choong Seon Hong|Eui-Nam Huh


Anthology ID:DBLP:journals/ipm/HossainAMHH25
Year:2025
Venue:Information Processing and Management
Pages:104056
URL:https://doi.org/10.1016/J.IPM.2024.104056
DOI:https://doi.org/10.1016/J.IPM.2024.104056
DBLP:journals/ipm/HossainAMHH25
BibTeX:
@article{hossain-2025-logit, author = {Md. Imtiaz Hossain and Sharmen Akhter and Nosin Ibna Mahbub and Choong Seon Hong and Eui-Nam Huh}, title = {{Why logit distillation works: A novel knowledge distillation technique by deriving target augmentation and logits distortion}}, journal = {Information Processing and Management}, volume = {62}, number = {3}, pages = {104056}, year = {2025}, url = {https://doi.org/10.1016/J.IPM.2024.104056}, doi = {https://doi.org/10.1016/J.IPM.2024.104056} }