It's true, there is no official warning.
Stories of SD card interfering with an OTA or reset seem to be getting more rare on the forum as well. Maybe everyone moving to a better card quality?
If it makes you feel better to remove the SD, it certainly won't hurt a thing. I still do it. Better safe than sorry, correct?