The Impact of Quantization on Retrieval-Augmented Generation: An Analysis of Small LLMs.
Mert Yazan|Suzan Verberne|Frederik Situmeang
| Anthology ID: | DBLP:conf/ir-rag/YazanVS24 |
|---|---|
| Volume: | Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024) co-located with the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2024), Washington DC, USA, 07 18, 2024. |
| Year: | 2024 |
| Venue: | Workshop Information Retrieval's Role in RAG Systems (IT-RAG) |
| Publisher: | CEUR-WS.org |
| Pages: | 77-81 |
| URL: | https://ceur-ws.org/Vol-3784/short6.pdf |
| DBLP: | conf/ir-rag/YazanVS24 |
| BibTeX: |
@inproceedings{yazan-2024-impact,
author = {Mert Yazan and
Suzan Verberne and
Frederik Situmeang},
editor = {Fabio Petroni and
Federico Siciliano and
Fabrizio Silvestri and
Giovanni Trappolini},
title = {{The Impact of Quantization on Retrieval-Augmented Generation: An Analysis of Small LLMs}},
booktitle = {{Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024) co-located with the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2024), Washington DC, USA, 07 18, 2024}},
series = {CEUR Workshop Proceedings},
volume = {3784},
pages = {77--81},
publisher = {CEUR-WS.org},
year = {2024},
url = {https://ceur-ws.org/Vol-3784/short6.pdf}
}