Question about "KV cache is reset to zero"
Closed this issue · 2 comments
YukiChen-yuxin commented
Hi, the SirLLM is awesome! Just curious about one point, you mentioned "DailyDialog and Grocery Shopping datasets, where the KV cache is reset to zero after each round", then how does LLM remember the info about the grocery list in the final round if the KV cache is reset.
Thanks!
Zoeyyao27 commented
Hello! Thank you for your interest in our work. In our paper, a round consists of multiple turns of dialogue. Figure 8 illustrates a round of dialogue in the Grocery Shopping dataset. Please feel free to check it out.
YukiChen-yuxin commented
Got it, thanks!