Questions about the CAM algorithm
Opened this issue · 0 comments
icoderzqliu commented
It seems that there are implementations related to the CAM algorithm in utils_hh
, utils_lm_eval
, and pos_shift
's modify_llama_cam.py
, and they are all somewhat different. Could you please explain the differences between these, and is there a simplest CAM implementation that can be referred to? The current code is a bit confused.