Bash script to copy files using a CSV file as input.
The CSV file contains the source files to be copied and their destination directory. Files can be copied locally or to a remote host.
Download bulkcp into /usr/local/bin so that it can be run from anywhere:-
sudo wget https://raw.githubusercontent.com/madaboutbrighton/bulkcp/master/bulkcp -O /usr/local/bin/bulkcp
sudo chmod a=rx /usr/local/bin/bulkcpThe CSV file contains the source files to be copied and their corresponding destination directories. It should be in the following format...
| Name | Done | Source | Destination directory |
|---|---|---|---|
| My directory | /some/folder/My directory | /mnt/usb/data | |
| Another directory | Y | /Some/folder/Another directory | /mnt/usb/data |
| Some files | /some/folder/*.* | /mnt/usb/data/some/folder |
A header row is expected, but optional. Use the --no-header option if your CSV file does not have a header row. Data inside the CSV file can be double-quoted, but this is not required unless the data contains a comma. Paths may contain wildcards (*).
The name of the directory or data to be copied. This is used for status updates.
A "Y" indicates that this item has already been copied. Any items with "Y" in this field are ignored.
The source file or directory to be copied. Directories are automatically copied recursively.
The parent directory that the souce files and/or directories will be copied into.
bulkcp data.csvThis would process data.csv, copying all source files specified in the CSV file to their corresponding destination directories on the local machine. This process uses the cp command.
bulkcp --remote-host "myuser@192.168.1.123" data.csvThis would process data.csv, copying all source files specified in the CSV file to their corresponding destination directories on the remote machine, 192.168.1.123. This process uses the scp command. It is only possible to copy files to a remote host if you set up ssh keys.
bulkcp --dry-run data.csvThis would process data.csv without any changes being made to the file system. Verbose output will be printed to the terminal.
The path of the CSV file to be processed. This is required.
Perform a trial run with no changes being made to the file system. Verbose output will be printed to the terminal.
Flag to indicate that the CSV file does not have a header row.
Service to notify when script completes. Currently supports a Slack Webhook URL.
Remote host where the files will be copied to. In the format name@ipaddress, for example, myuser@192.168.1.123. It is only possible to copy files to a remote host if you set up ssh keys.
Increase the amount of information printed to the terminal.
bulkcp uses scp to connect to a remote host and ssh to issue any other commands, such as mkdir. It would be insecure to store the password of your remote host in a variable, and inconvenient to have to enter the password multiple times. It is therefore recommended to use ssh keys when requiring bulkcp to copy files to a remote host.