I shared your sentiments when I first got an Xbox one, but now, I love it and I stopped purchasing the discs. Digital all the way! Never having to swap discs, saving storage space instead of a shelf full of cases.
Personaly I hate this. So, let's see your feelings here. Coming from a 25mb/15mb internet net connection (fair and a lot faster than a lot of people, although I would like a litlte faster). Modern games...let's see Mafia 3, Titanfall 2, Watch Dogs 2, Gears 4... all of these games are at LEAST 45gb and most of them are closer to 60gb.
So, I did a compare of installing, one both about 60gb, One I ordered digitally and one I picked up a retail disc and did a basic time (watching a clock), the digital one took almost 3 hours before it was playable online (Ready to play only allows signle player and in a lot of cases allows you to load the menu but, do nothing else). This was a 60gb game with a 1.5gb update...
On the pysical disk, it took 45 min(closer to an hour) before it was ready to play this included a 2.2gb update. So if you get home from work and you want to buy a game to play tonight(say a Friday night), you DONT want to buy the digital game, you want to run to the store to buy it.
No matter how people feel this a where Microsoft is going to go and how possable this is great. Even my ISP Comcast has a hidden CAP of downloads, it's 250gb (it's in the fine print, read it), if you go over it once, they can send you an email but, if you keep going over it, they hold the right to cancel your account. It's possable that a 4K game on scorpio could be up towardeds 100gb a game (look at some high end PC games). Downloading 2-3 games puts me where I could get my ISP canceled.
I also have a 2tb drive connected to my system but, the other day I booted up my WiiU... Wanted to play some MarioKart 8 (fun game)... I dropped in the disk and about 30 seconds later I was playing the game, No install to the hard drive, needing extra hardware because games are so HUGE. There is something to be said here for classic gaming...
Then there is always the other side of the physical vs. digital games. 20-25 years from now, when the Xbox one is just a memory. Xbox live is NO longer available for the Xbox one, Xbox one S, or Scorpio (what ever its going to be named), and with Microsoft, it's just a matter of time before they kill support (look at past version of Windows or even the original Xbox). So in this time, people will want to play their CLASSIC games, with No Xbox live on the Xbox one systems.... If you own a digital game, you MIGHT not be able to get your game any more but, if I drop in a physical game, I should be able to play it...
And your digital game 10 years from now, still has the same cash value as it has now... NOTHING. 10 years from now, the pysical game could be worth good money.