/Visflow

Tools for easy use of irods in conjunction with makeflow

Primary LanguageShell


What is Visflow?

Visflow is a shell toolchain used to decrease the time and effort it takes to go from personal computer to the cloud. This program is used in conjunction with the iplant datastore and futuregrid to make using the cloud almost trivial.
Here is a Prezi presentation for more information about this project.

Who does it appeal to?

The main demographic that will benefit from this is the research and data intensive community.

How is Visflow used?

In any bash (shell) clone the git repo and run visflow.sh by using 'sh visflow.sh'.

What is irods?

Irods is a way to use the iplant collaborative enviroment through shell commands.

Where is the irods configuration file stored?

~/.irods/.irods/.irodsEnv

What is located in the .irodsEnv file?

Everything needed for irods to connect to iplant except the password.

The irods password was stored, but now it will never be stored or sent.

What format must the iplant folder be in?

There should be one directory with all the files needed including script and data files.
For example  
Simulation/  
--> simulation.py
--> sim_files/
----> file1.txt
----> file2.txt
----> file3.txt

Script file details

-split_option.sh
	splits local or remote files found on irods and returns them from 	
	whence they came in either a /splits or /chunks directory

Latest update:

+ reduced the number of files by making functions rather than seperate .sh files.   
+ no passwords are ever stored (you must be logged into irods on host and worker computers)   
+ error catching   
+ simple step-by-step instructions   
+ Visflow.info integration   

Future updates:

+ clean up after computation is done   
+ ability to take in multiple data files   
+ expand documentation   
+ make tutorial video