Can be used to protect the circuit from increases in voltage. Pick a Zener breakdown voltage that is close to your desired output voltage and the Zener diode will prevent the load voltage from exceeding this value. The Zener will reliably bypass the load when reaching voltages above its breakdown level.
Try increasing the supply voltage and see.
