when uploading many files: httpcore.ReadTimeout: timed out
Closed this issue · 0 comments
I'm working on upgrading our "sample data" app to pyDataverse 0.3.2:
@JR-1991 @jp-tosca and I have been discussing some challenges at https://dataverse.zulipchat.com/#narrow/stream/377090-python/topic/upgrading.20.22sample.20data.22.20from.20pyDataverse.200.2E2.2E1.20to.200.2E3.2E2
I'm hitting some kind of timeout when running api.upload_datafile(dataset_pid, df_filename, df.json()), especially when uploading a dozen or so files to a dataset.
"The default behavior is to raise a TimeoutException after 5 seconds of network inactivity" according to https://www.python-httpx.org/advanced/timeouts/
@JR-1991 suggested trying a524c1c which adds timeout=None and it seems to be helping. I can create all the sample datasets and upload files, as before.