If you have a problem with the review, for your product, msft are enabling the ability to directly respond to the review. Removing them? Would defeat the purpose, as the chap above said.
I understand your sentiment, OP. I have a couple of unfair 1 star reviews. They put my app into read only mode and then gave me 1 star for not being able to write in the document.