phoboslab/jsmpeg-vnc

How to push audio

pssrecom opened this issue · 6 comments

I want to push audio, how should I achieve it, thank you!

I don't think mpjpeg will be able to incorporate sound. This uses ffmpeg to push the data. Consider changing mjpeg to VP9, which may reduce bandwidth and increase clarity at the same time.

Have a look at the current JSMpeg version – it's able to accept a MPEG-TS stream, including mp2 audio. Using the updated JSMpeg for the client and implementing audio encoding and TS packetization in this project is certainly possible. My Magic Webcam App does exactly this.

That said, I currently don't have any interest in updating jsmpeg-vnc myself. Pull Requests are welcome.

Have a look at the current JSMpeg version – it's able to accept a MPEG-TS stream, including mp2 audio. Using the updated JSMpeg for the client and implementing audio encoding and TS packetization in this project is certainly possible. My Magic Webcam App does exactly this.

That said, I currently don't have any interest in updating jsmpeg-vnc myself. Pull Requests are welcome.
Magic Webcam App, Ipad pro(2021).
Lan Env. about 200~300ms delay.

No 100ms delay was tested.

Use the Ipad's camera to point at a timed web page; This web page is accurate to a thousandth of a second. In another browser, open the playback screen. The screen capture shows that the delay is about 200 to 300ms. The whole Intranet environment is used, and the network condition is good. May I ask how can I test the 100ms delay you mentioned?
I use the free version of the Magic Webcam App. The 2021 Ipad Pro. IOS16.