I had the same issue with my Bluetooth headphones. Turned out the headphones had the volume all the way up. When I lowered the volume on them it cleared the high pitch noises that played through. I use the Lumia to control volume instead.
Hope this helps!