The best way to describe this problem is to say what I did to cause it:
- I put music on the phone that I knew I wanted only temporarily, intending to delete it later
- I deleted said music using Microsoft's own Files file manager app in order to get rid of it
- Now the deleted music still...