Just to make sure, are you filtering so that it only shows music "Available Offline"? Does it happen after a reboot, and with airplane mode turned on?
I had a problem where I would copy music via playlists, and then after I deleted the music file it would get copied back. This happened over and over until I figured out that Groove had saved my playlist and kept going to my online library and re-downloading the music file.