Hey after about an hour of troubleshooting I finally made it work. Now the top potentiometer is for coarse pitch and the switch which will be rotary and have alot more resistance options is for large hz changes. This is the core to a little synth I'm making my Girlfriend and it's looking good so far.
Added filter
Added mixer
Added amp
Added 50k for lower pitch