team-reflect/transformers-playground

Preparation

For Node.js:

$ cd transformers-playground

# Make sure that Node.js is installed
$ node --version
v18.16.1

# Install dependencies
$ corepack enable
$ pnpm install

For Python

$ cd transformers-playground

# Make sure that Python is installed
$ python3 --version
Python 3.11.4

# Install dependencies
$ python3 venv venv
$ source ./venv/bin/activate
$ pip3 install torch transformers

Usage

$ cd transformers-playground

# Run python3 script
$ pnpm run:python

# Run Node.js script
$ pnpm run:node

# Start a web server, then click the buttons in the browser to start the benchmark.
# The result will be printed in the browser console.
$ pnpm run:browser

Benchmark result (M2 MacBook Air)

Environment	CPU usage	Time (seconds)
Chrome - 1 worker	100%	300
Chrome - 1 worker - 4 threads [1]	100%	303
Chrome - 4 workers	400%	94
Chrome - 8 workers	700%	72
Chrome - 16 workers	700%	69
Safari - 1 worker	100%	163
Safari - 1 worker - 4 threads [1]	100%	162
Safari - 4 workers	400%	49
Safari - 8 workers [2]	N/A	N/A
Node.js	350%	33
Python	300%	31

[1]: I cannot get multiple threads to work

[2]: Error: no available backend found. ERR: [wasm] RangeError: Out of memory