Support the LDS metric
Closed this issue · 1 comments
Jiaxin-Wen commented
The Section 2 of the trak paper proposes using LDS as the main metric to evaluate data attribution methods, which reduces the reliance on manual inspection, providing a more automated and objective assessment.
Would you like to support the LDS metric in this repository?
kristian-georgiev commented
The only code needed to compute the LDS metric outside of scripts for training & recording margins is available in the quickstart notebook and in the tests:
Lines 177 to 205 in 39bf22a
In case there's community interest to provide more explicit support for LDS (and possibly counterfactuals as well), I'm leaving this is as a discussion.