webdataset
There are 10 repositories under webdataset topic.
webdataset/webdataset
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
huggingface/chug
Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
sutd-visual-computing-group/Fourier-Discrepancies-CNN-Detection
[CVPR 2021: Oral] In this work, we show that high frequency Fourier spectrum decay discrepancies are not inherent characteristics for existing CNN-based generative models.
robvanvolt/DALLE-tools
DALLE-tools provided useful dataset utilities to improve you workflow with WebDatasets.
npuichigo/tarzan
High-level API for tar-based dataset
yuleiqin/fopro
This repo is the official released code of FoPro (AAAI-2023)
mlfoundations/webdataset-resharder
Efficiently process webdatasets
MichaelNoya/nih-chest-xray-webdataset-subset
A sample subset of the NIH Chest X-ray Dataset. At only 2.4% of the size of the original dataset, it allows creating an accurate classifier using the Augmented Chest X-Ray repository.
HemuManju/carla-data-collector
Scripts to collect data from CARLA and save them as Webdataset
loickntb/Wiki-Mind
Web project, using SparQL on dbpedia and wikidata for mental disorder search feature