Pinned issues
Issues
- 0
GDriveReaderDataPipe complains "using a sharing/viewing link instead of a download link"
#1265 opened by huaixv - 0
StatefulDataLoader stores worker state twice if the IterableDataset is also an Iterator
#1259 opened by gokulavasan - 3
torchdata not compatible with torch 2.3.0
#1244 opened by mmdanziger - 2
- 0
[StatefulDataLoader] macOS tests are too slow
#1247 opened by andrewkho - 0
- 1
DataLoader2 with multiprocess raise exception: Can not request next item while we are still waiting response for previous request
#1228 opened by npuichigo - 9
- 28
Future of torchdata and dataloading
#1196 opened by laurencer - 1
Make archive datapipes faster
#1191 opened by lei-rs - 3
Dataloader is slow with iterdatapipes and shuffle that has large in-memory fields (because traverse_dps is slow)
#1226 opened by olegsinavski - 3
- 1
prefetcher shutdown hang when running with multiprocess + distributed reading service
#1176 opened by zhengwy888 - 1
`v2.1.2+cu118` and `v2.1.1+cu118` run into torchdata `ImportError: libssl.so.3: cannot open shared object file: No such file or directory`, that `v2.1.0+cu118` doesn't have an issue with
#1220 opened by justinxzhao - 0
Iterating a data pipe, created with random split, ends in error as the code tries to iterate past the data pipe lenght
#1218 opened by thecaptain2000 - 0
S3FileLoaderIterDataPipe buffer_size
#1215 opened by commonism - 0
- 3
- 3
Crash when resetting datapipe with bufffer of filehandles
#1161 opened by falckt - 3
`header()` causes DataLoader with MPRS to hang
#1148 opened by wchang-apixio - 6
Is torchdata still being actively developed?
#1192 opened by lendle - 2
- 1
Does Collator need to exist?
#1181 opened by lendle - 0
torchdata has a very low accuracy
#1194 opened by jc-su - 0
An iterator that can stream over stdin
#1193 opened by erip - 3
Dataloader2 with FullSyncIterDataPipe throws error during initilization
#1190 opened by chenxingyu-cs - 1
- 2
- 11
Memory spikes with large DataPipes
#1150 opened by sesquipedalianist - 0
MultiplexerLongest example snippet isn't very useful
#1182 opened by lendle - 2
what is the right way to serialize DataLoader2 so that pipeline with shuffle can resume from the right place?
#1177 opened by zhengwy888 - 0
Using ShardingFilterIterDataPipe with MPRS may cause unnecessary batch drops.
#1180 opened by yuxinyuan - 1
- 3
Mux with MPRS causes operations after sharding_round_robin_dispatcher to run on the same worker
#1175 opened by JohnHBrock - 9
Deadlock / Race-condition after latest update
#1169 opened by sehoffmann - 3
MPRS hangs if child processes get killed externally (e.g. from OOM reaper)
#1173 opened by sehoffmann - 0
- 3
[RFC] Performance Profiling Tools
#1149 opened by NivekT - 1
- 0
Caching doesn't work with cycle
#1167 opened by Modexus - 0
- 0
- 1
Additional basic functions beyond .map to allow for more functional programming
#1145 opened by hhoeflin - 1
Add zlib support to Decompressor
#1163 opened by JohnHBrock - 0
InMemoryCache dp will yield from source dp once even when data is fully cached
#1159 opened by hirayaku - 1
Race condition when prefetching forks
#1162 opened by falckt - 1
- 7
- 0
Improve AsyncIODataPipe
#1155 opened by ejguan - 2
AttributeError: 'SequenceWrapperMapDataPipe' object has no attribute 'prefetch . when using MultiProcessingReadingService
#1143 opened by One-sixth