Omniscope Mutliviewer for the Browser

Install:

in your terminal, write

npm install

for the Omniscope APP

cd

Showcase

For the raspberry pi

sudo apt update
sudo apt upgrade

sudo apt install -y ca-certificates curl GnuPG
curl -fsSL https://deb.nodesource.com/gpgkey/nodesource-repo.gpg.key | sudo gpg --dearmor -o /usr/share/keyrings/nodesource.gpg
NODE_MAJOR=18
echo "deb [signed-by=/usr/share/keyrings/nodesource.gpg] https://deb.nodesource.com/node_$NODE_MAJOR.x nodistro main" | sudo tee /etc/apt/sources.list.d/nodesource.list
sudo apt update
sudo apt install nodejs
node -v

git clone https://github.com/Matchboxscope/Omniscope-MultiCamViewer
cd Omniscope-MultiCamViewer/server
npm install
npm run

cd Omniscope-MultiCamViewer/client
npm install
npm run

Jetson Nano

sudo apt-get install curl
curl -sL https://deb.nodesource.com/setup_12.x | sudo -E bash -
sudo apt-get install -y nodejs

Electron

cd electron
npm run electron-start

npm install --save-dev electron-builder
npm run dist -- -w
npm run dist -- -m

Ports

The following ports will be used for specific functions:

locahost:12345 - UDP: streams the server IP so that the ESP32 knows where the socketserver is sitting
localhost:8000/ - serving the APP (e.g. localhost:8000) 
localhost:8000/setIPPort - announce the camera ID from the esp32 side: curl -X 'POST' 'http://192.168.0.116:8000/setIPPort' -H 'accept: application/json' -H 'Content-Type: application/json'  -d '{"ip": "192.168.1.1", "port":8001}'

Sensors

Once a camera connects to the server it announces it's unique 3-digit ID to the socket server. The socket server will create a new camera slot and assings an accessinding ID. This will be stored in the sensor.json for later use (e.g. when the server restarts):

{
  "6": {
    "port": 8006,
    "class": "cam-instance",
    "display": "Cam#4",
    "id": "4"
  },
  "65": {
    "port": 8065,
    "class": "cam-instance",
    "display": "Cam#6",
    "id": "6"
  },
  "84": {
    "port": 8084,
    "class": "cam-instance",
    "display": "Cam#3",
    "id": "3"
  },
  "379": {
    "port": 8379,
    "class": "cam-instance",
    "display": "Cam#7",
    "id": "7"
  },
  "386": {
    "port": 8386,
    "class": "cam-instance",
    "display": "Cam#1",
    "id": "1"
  },
  "530": {
    "port": 8530,
    "class": "cam-instance",
    "display": "Cam#8",
    "id": "8"
  },
  "541": {
    "port": 8541,
    "class": "cam-instance",
    "display": "Cam#9",
    "id": "9"
  },
  "613": {
    "port": 8613,
    "class": "cam-instance",
    "display": "Cam#2",
    "id": "2"
  },
  "626": {
    "port": 8626,
    "class": "cam-instance",
    "display": "Cam#12",
    "id": "12"
  },
  "633": {
    "port": 8633,
    "class": "cam-instance",
    "display": "Cam#11",
    "id": "11"
  },
  "742": {
    "port": 8742,
    "class": "cam-instance",
    "display": "Cam#10",
    "id": "10"
  },
  "950": {
    "port": 8950,
    "class": "cam-instance",
    "display": "Cam#5",
    "id": "5"
  }
}

Timelpase Imaging

All camera frames will be stored periodically in the folder: ./server/saved_images

Errorhandling

If a camera (e.g. ESP32 Xiao) loses connection to the Wifi: It'll restart and announces it's ID/Port to the server. It'll use the same camera ID as previously assigned by the Socket Server, hence keeps it's position in the 24 camera grid
if the socket server connection will break, the camera will automatically restart and try to reconnect

Camera Lenses

https://www.largan.com.tw/html/product/alllist/all-list.htm

Errors:

----- Uncaught exception -----
sensor.js:31
RangeError: Invalid WebSocket frame: RSV2 and RSV3 must be clear
    at Receiver.getInfo (/home/bene/Downloads/Omniscope-MultiCamViewer/server/node_modules/ws/lib/receiver.js:171:14)
    at Receiver.startLoop (/home/bene/Downloads/Omniscope-MultiCamViewer/server/node_modules/ws/lib/receiver.js:131:22)
    at Receiver._write (/home/bene/Downloads/Omniscope-MultiCamViewer/server/node_modules/ws/lib/receiver.js:78:10)
    at writeOrBuffer (/home/bene/Downloads/Omniscope-MultiCamViewer/server/lib/internal/streams/writable.js:391:12)
    at _write (/home/bene/Downloads/Omniscope-MultiCamViewer/server/lib/internal/streams/writable.js:332:10)
    at Receiver.Writable.write (/home/bene/Downloads/Omniscope-MultiCamViewer/server/lib/internal/streams/writable.js:336:10)
    at Socket.socketOnData (/home/bene/Downloads/Omniscope-MultiCamViewer/server/node_modules/ws/lib/websocket.js:1162:35)
    at Socket.emit (/home/bene/Downloads/Omniscope-MultiCamViewer/server/lib/events.js:513:28)
    at addChunk (/home/bene/Downloads/Omniscope-MultiCamViewer/server/lib/internal/streams/readable.js:315:12)
    at readableAddChunk (node:internal/streams/readable:289:9) {code: 'WS_ERR_UNEXPECTED_RSV_2_3', stack: 'RangeError: Invalid WebSocket frame: RSV2 and…dChunk (node:internal/streams/readable:289:9)', message: 'Invalid WebSocket frame: RSV2 and RSV3 must be clear', Symbol(status-code): 1002, Symbol(kEnhanceStackBeforeInspector): ƒ}

sensor.js:32
----- Exception origin -----
sensor.js:33
uncaughtException
sensor.js:34
----- Status -----