I found what the problem is. I did not restart my kernel when previously I had imported hvplot.pandas via import hvplot.pandas
So apparently, hvplot.pandas overrides any changes to css. Is there a way to prevent hvplot.pandas from over-riding the css_class?