OK, I found the relevant section.
I had it set to "through my control panel only" and it wasn't doing this automatically. Changed it to instant, with email.
I thought this was only for NOTIFICATIONS of what Im subscribed to. I'd rather not have emails sent for all of the threads I subscribe to, but manage them through control panel only. That's what I thought I was selecting earlier.