You can see the result below. Had not thought it to be this performant so I thought it might be useful to share here.
It works in Chrome, but unfortunately
scikit-image raises an out of memory error when loading the app in Firefox.
The performance of the server-based app is also pretty amazing. I can get +10fps out of the box including a round trip from my client in Denmark to a server in Amsterdam and back.
I’m working on adding the example to the Panel Gallery. Add Gallery VideoStream example by MarcSkovMadsen · Pull Request #4047 · holoviz/panel (github.com)