Okay I managed to fix this using this issue thread (CSS is missing when inlining static resources. · Issue #5167 · holoviz/panel · GitHub and Add ability to inline internal resources in Jupyter · Issue #3013 · holoviz/panel · GitHub).
Essentially,
pn.extension(inline=True)