Retrieving multiple files at the same time.

Question

Retrieving multiple files at the same time.

Opened this issue 8 years ago · 5 comments

I would like to send to galaxy more than one file. In the current example: https://github.com/erasche/galaxy-data_source-examples/blob/master/flask/sync.py#L71 I can see only one dataset can be sent. Can you let me know how can I do that?

Regards
Yasset

Answer 1 · 2018-02-12T08:59:37.000Z

Hi @ypriverol, I'm not sure it is possible to send back multiple datasets. What you could do is you could sendback a tarball and Galaxy should try and extract the files from within the tarball.

@blankenberg is this possible?

Answer 2 · 2018-02-12T09:05:09.000Z

Is only one dataset but multiple files. If we need to send a compressed file that means that I need to compress the data in my side before sending it? @bgruening

Answer 3 · 2018-02-12T09:10:13.000Z

Oh, a composite dataset? This is... interesting. I'm not sure that is possible to do currently, but @blankenberg would know better than I would.

Answer 4 · 2018-02-12T09:23:36.000Z

Not a composite dataset, I don't think so. @ypriverol is talking about a "study", that contains multiple files of the same type. We could think about a collection, but the underlying problem is can I pass a list of filenames to Galaxy, so that Galaxy can download them one-by-one?
This should be possible, I just do not know what is the best.

A simple way would be to just send a text file with URLs of all datasets and we download then one-by-one iterating over the file.

Answer 5 · 2018-02-12T09:24:45.000Z

I will be great if we can pass a set of URLs to download and you start from there.