golemfactory/ray-on-golem

`ray rsync-down` fails on larger files after several seconds

shadeofblue opened this issue · 1 comments

shadeofblue commented

steps:

  1. ray up
  2. ray submit golem-cluster.dev.yaml examples/mandelbrot_image_gpu.py -- -s 6000 4000
  3. ray rsync-down golem-cluster.dev.yaml mandel-6000x4000-20240222_163053+0000.png .
$ ray rsync-down golem-cluster.dev.yaml mandel-6000x4000-20240222_163053+0000.png .
Loaded cached provider configuration
If you experience issues with the cloud provider, try re-running the command with --no-config-cache.
Ray On Golem 0.8.0a1
  Not starting the webserver, as it's already running
Fetched IP: 192.168.0.3
Error: SSH command failed.
mateuszsrebrny commented

Might be an emanation of the head connectivity issue - leaving for now to wait for tunnel monitoring works