In the Now Playing screen, if you have a little icon which looks like ((o)) next to the song title, then you're streaming. Otherwise the music is playing locally from the phone.
In other news, I got a nice pair of Bluetooth headphones for Christmas (Philips SHB9100/00, I highly recommend them)...