The 8.1 update now brings separate volume toggles for music.
Check your volume settings by tapping the volume button to bring up your volume controls. When you tap it, you should be able to see an arrow on the right side of your screen. Tap the arrow to see where your "media + apps" volume setting is. Try moving it around to see if that improves any.