dustinblack/arca-smallfile

arca-smallfile is a workload plugin of the smallfile benchmark tool using the Arcaflow python SDK

smallfile workload plugin for Arcaflow

arca-smallfile is a workload plugin of the smallfile benchmark tool using the Arcaflow python SDK.

Supported smallfile parameters are defined in the SmallfileParams schema of the smallfile_plugin.py file. You define your test parameters in a YAML file to be passed to the plugin command as shown in smallfile-example.yaml.

To test:

In order to run the smallfile plugin run the following steps:

Containerized

1. Cone this repository
2. Create the container with docker build -t arca-smallfile .
3. Run docker run arca-smallfile -f smallfile-example.yaml

Note that the smallfile-example.yaml in this case is added to the container image with the docker build command, so the container should be rebuilt after any changes to the file.

Native

Prerequisite: smallfile should already be installed on your system.

1. Clone this repository
2. Create a venv in the current directory with python3 -m venv ./venv
3. Activate the venv by running source ./venv/bin/activate
4. Run pip install -r requirements.txt
5. Edit smallfile_plugin.py to set smallfile_dir=<path_to_smallfile_dir>
6. Run ./smallfile_plugin.py -f smallfile-example.yaml