Add Model/Dataset Active-learning/Evaluation support
jacobbieker opened this issue · 1 comments
jacobbieker commented
Something like Scale's Nucleus, or this open source one https://voxel51.com/fiftyone/ or something with https://github.com/facebookresearch/faiss for finding very different examples and seeing where the model works/doesn't, and which examples it should see more. Some kind of active learning or something.
JackKelly commented
Yeah, and this could be really useful for finding bad examples, too (perhaps related to openclimatefix/predict_pv_yield#41)