Found the solution. That's what I get for clicking stuff carelessly.
Open outlook, tap the ... at the bottom right, choose settings and then options. Midway you will you will see the notification settings. Click on "Play a Sound" and if you want "Show a notification banner". But the "Play a...