Welcome to the community.
If you have a lot of widgets I would actually take a look at creating a custom template https://panel.holoviz.org/user_guide/Templates.html.
That will give just the most performant app.
If you could post a small code example based on Gridspec it would be a good starting point for getting help.