For what it’s worth, I encountered a very similar issue with Jupyterlab 3.6.1 and Panel 0.14.3.
pyviz_comms 2.2.1 was installed, but I could not get any interactivity from Panel widgets in Jupyterlab (the same widgets worked as expected in Jupyter notebook).
Installing Panel into the base conda environment solved the problem.