If this is an unlocked device, yes you would have to set the internet APN to send and receive MMS. You just have to set it, turn off the phone and then turn it back on for it to go into effect.
I don't understand what you mean by stay on, it wouldn't do anything if there's no SIM.