Demonstration of how you can make an LED normally on or normally off with NMOS and PMOS, where it toggles its state when the switch is pushed.
For NMOS, for the LED to be normally lit, a pullup is connected to the power. For it to be normally off, a pulldown is connected to the ground.
For PMOS, for the LED to be normally lit, a pull down is connected to the ground, and for it to be normally off, a pullup to power.