`rasterize`-ed QuadMesh disappears on zoom in Bokeh in a Panel dashboard

I’m not sure where this belongs (or what tool is to blame).

I’m trying to use rasterize with to speed up plotting of weather maps in Bokeh in a Panel dashboard. However, when I try to pan or zoom in Bokeh, the plot disappears.

Here’s a simple example: https://gist.github.com/tdhopper/aeaf1ac7010b529dae8182226f38035c.

I run this with panel serve rasterize.ipynb.

When I try to pan or zoom the plot in the browser, the plot disappears and I get this

/opt/conda/lib/python3.7/site-packages/xarray/core/nputils.py:227: RuntimeWarning: All-NaN slice encountered
  result = getattr(npmodule, name)(values, axis=axis, **kwargs)
/opt/conda/lib/python3.7/site-packages/xarray/core/nputils.py:227: RuntimeWarning: All-NaN slice encountered

Can anyone provide any guidance as to what is happen (or where I should open an issue)?