Well this had me baffled for some time, but it turns out the AllowPartialTrustedCallers attribute on the debugger visualizer assembly causes this. Removing that makes it work.
We'll ship a hotfix for this later today for 5.9 and 5.10 (as we have another issue to fix in the runtime as well).