They have been using that logo for a lot longer than it has been showing up in Office applications. It has also been the Microsoft Store logo for a long time.
The inspiration is a WINDOW, lol. It looks like a window pane. It also inspired metro design, as you can tell. We have many squares on our windows phones.