Just open the switch.
Power supply for vacuum tube projects if you don't have an isolation transformer. They are always bulky, expensive, and hard to come by. Since almost all vacuum tubes use a high inductance transformer in their anode chains, the transformer will acts as a constant current source, and the RF switching noise won't make it to the tubes. Also, it's outside the audible range. It takes a while to integrate the output and settle!