Update: I am a dummy who skipped the styling components documentation. I am pretty much able to achieve what I want by applying a design to the extension like so pn.extension(design='material'). More information on this topic can be found on [this page].(Apply a Design — Panel v1.2.1)
2 Likes