I've been getting the same error with the Windows Store update of Music using Windows 10 for Phone. I was getting other ones also, but those I could just delete and add back. Music isn't deletable.
Is there any resolution for this yet? I'm seeing the issue for the Windows Insider app on top of OneDrive, XBox Music, Microsoft Band/Health and Facebook Beta. I'm afraid the Insider update is an attempt to fix this, but if it won't update we're kinda screwed.