DiracFiles
Opened this issue · 2 comments
mesmith75 commented
For some reason new members are using LocalFile for their tuple outputs when running on the grid. The advice for many years has been to store job output on the grid.
This needs to be made clear in the starterkit.
alexpearce commented
We do say in the More Ganga lesson:
To avoid filling up the filespace, it is wise to put the large files produced by your job somewhere with lots of storage - the grid.
But we do say in the "Storing large files on EOS" lesson
To retrieve a job outputfile, one can use two types of files:
- LocalFile: the standard one with the output file directly downloaded to the gangadir.
- DiracFile: the output file is stored directly on the grid and be accessed through the XRootD protocol.
We could add a caveat here (or in both places) to highlight that LocalFile
is intended only for small (< 10 MB?) files.
chrisburr commented
This lesson uses a LocalFile
with the grid. I guess people might copy from there without realising.