golemfactory/ya-runtime-ai

reverse ssh experiment

Opened this issue · 0 comments

Verify the feasibility of the reverse ssh architecture.

Experiment scenario:

  • a single node that would proxy traffic through reverse ssh (ubuntu, aws t3.medium)
  • 10 server nodes with 100 containers serving http streaming content
  • 1 node with 1000 containers requesting http traffic through proxy from servers

Observations:

  • proxy server has not reached its capacity with
    • ~95% memory usage (4GB available)
    • ~30% cpu usage (2 vCPUs available)
  • high throughput - up to 20GB/s

Image

Code used for testing:
https://github.com/staszek-krotki/remote-ssh-test/tree/master