Depends of the platform:
- On Windows 8/8.1/10: use powershell to uninstall the application (see this article)
- On Windows 10 Mobile: I have no idea (and I don't think there is a way)
But you could simply change your default application for your music files.