Right click on taskbar, in context menu go to Cortana>Show search box, there you go, now you have microphone icon and Cortana in taskbar.
Note: if you have "Use small taskbar buttons" in Taskbar and Start Menu Properties enabled, Cortana stays as a circle, no search button is available.