Seems done on purpose and is pretty stupid.
Just another stupid thing about Tablet mode right now. you turn this off by switching to desktop mode
They are forcing desktop elements in tablet mode like the taskbar but make the desktop portion unusable even though it is stuck their in the background.
They really should just make tablet mode like Win 8.1 and just tweak a few things.