How are the unlearning evaluation metrics computed?
Opened this issue · 6 comments
saptab commented
Is the evaluation metric public?
Please share how the evaluation metric is computed
fabianp commented
We're working on making it open source. I expect it to take a couple of weeks
saptab commented
Hi Fabian, following up about the open source metric since its been two weeks :)
looking forward to learn about it and run it
fabianp commented
Unfortunately many people in the team have been busy with the ICML
deadline, which I hadn't considered when I responded earlier. A more
realistic timeline will be before the end of February. Apologies for the
delay
…On Sun, Feb 4, 2024 at 6:47 PM saptab ***@***.***> wrote:
Hi Fabian, following up about the open source metric since its been two
weeks :)
looking forward to learn about it and run it
—
Reply to this email directly, view it on GitHub
<#17 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AACDZB5MZ5TV7RKQ65KRQTTYR7JSVAVCNFSM6AAAAABCDTTQT6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRVHA3TQNZWGY>
.
You are receiving this because you commented.Message ID:
***@***.***>
yasser-h-khalil commented
Hi @fabianp, when will the evaluation metrics be released?
fabianp commented
it's finally online: https://github.com/google-deepmind/unlearning_evaluation