[Question] Support for Images?

[tszumowski]

Hi! I have a question and it appears the Discord invite link is now invalid.

Do you have plans to support showing images in the map? Either:

(a) as part of the metadata, akin to what's shown for nomic.ai (in this example)

or

(b) as part of the map icon's themselves, as shown in in TensorFlow Embedding Projector, the "MNIST with Images" example, here:
https://projector.tensorflow.org/.

[enjalot]

Yes I'd love to support images! I think showing it in the metadata as in the first example you showed would be relatively straightforward, especially once #6 is done we could show thumbnails in the table if we detect an image url.

As for showing on the map, I do have some ideas for how that could be manageable, tho its often challenging depending on the size of the dataset. For larger sizes, doing a preprocessing step to generate tiles of thumbnails can be really helpful.

I actually want to support image embeddings in the future, using something like CLIP, and then we'd definitely want ways to show images on the map

Sorry about the discord link, i didn't realize they expire, here is a new one and i will update the README: https://discord.gg/x7NvpnM4pY

[enjalot]

I'm not showing images in the map yet, but they do show up in the table in 0.2.0
I will have to upload a tutorial. Showing images on the map may be a while down the road as it would mean another step to create some kind of sprite sheet for practical purposes