Go to your Settings, swipe over to Applications, go down to Photos+Camera you can turn off/on the geotag information there.
You can also change which app is opened when you press the camera button, if the Shutter speed of the Nokia Camera app bothers you switch it to the built-in app and the shutter delay will go away.