NUS-HPC-AI-Lab/InfoBatch

can the dynamic method obtain a final compressed small dataset

Opened this issue · 2 comments

Hi, I have read your impressive paper and have a question about the dynamic manner:
can the dynamic method obtain a final compressed small dataset for cross-architecture evaluation?

It is a good question, we will do some exploration on it. At this moment, my intuition is that if the pruned set becomes stable at later epochs, it can serve as a coreset selection methods (also may count how many times a sample is pruned and then select). But dynamic pruning method can take the benefit of assessing current learning status of samples, so whether it could obtain a final compressed small dataset and whether it would be good for cross-architecture is still to be investigated.

Thank you for the reply. I will keep an eye on the updates.