I was able to get rid of the US holidays on my phone and surface..
Log in to live.com on desktop browser and go to calendar
Press the settings (cog wheel icon, top right hand side of screen)
Click on the calendar you want to get rid of
Press delete (in the top bar)
Then on your phone go...