encord-team/text-to-image-eval
Evaluate custom and HuggingFace text-to-image/zero-shot-image-classification models like CLIP, SigLIP, DFN5B, and EVA-CLIP. Metrics include Zero-shot accuracy, Linear Probe, Image retrieval, and KNN accuracy.
Jupyter NotebookApache-2.0
Issues
- 1
Adding support for Hybrid-CLIP models such as MedCLIP variants also Evaluation Data saving.
#83 opened by TennoSerra - 0
Add support for multi-label classification datasets like `alkzar90/NIH-Chest-X-ray-dataset` from Hugging Face
#58 opened by eloy-encord - 0
Trouble adding `Qdrant/google-landmark-geo` Hugging Face geospatial dataset.
#57 opened by eloy-encord