Try it and see, I have my cable plugged in, my Xbox One then plugs into my receiver and that feeds my TV, I also have the Xbox One media controller.
In effect this means I am down to just one remote control as when I start or shut down the Xbox, it turns every thing else on or off. It also means I can watch TV, use the One Guide to see what's on, change to music or games and back to TV anytime I want and I can also snap it so I can keep an eye on what's on TV whilst doing something else.
Without Kinect I would say you would really need the media controller (There are also third party controllers available) to make sense of it as the standard controller would keep shutting down and need waking up and not be as useful.