All OS are more optimized than people think.
Then I will state that some OS' are a lot less optimized than you think.
I can leap into a lengthy post pointing out hundreds of situations where Android devices lack any type of optimization (on most handsets), but I'm not sure that would be appreciated.
Instead, simply consider this: Any optimizations Google makes to Android must be hardware agnostic, as Google may not make any assumptions about what types of hardware manufacturers ultimately decide to slap together. That is why stock Android generally fails to exploit much beyond the general purpose CPU cores. That is why giving Android devices two general purpose CPU cores, instead of just one, results in such a huge performance gain.
It's not even just about optimized hardware utilization, but also about optimizing the OS for the types of use-cases it is expected to encounter most often. Android utterly fails in this department too. Honestly, that we even need something like "project butter" on a dual-core 1GHz platform, just to get smooth UI performance, is so utterly ridiculous it is not even funny. Anyone implying this is anything but unoptimized "slop" is simply... I don't know... pick your own word
Edit: Personally, I think it is fair to label Android as bloatware.
Watching the Nokia phone app that edits video and pictures in real time, that could very very easily work faster with a quad core. So look at the software that Nokia is making with DC, what do you think they could do with a hex core ARM?
That would be utterly inefficient. That is what SOC's have specialized media processing cores for. WP8 devices actually have seven cores, not just two, but if the OS is to make use of them, it needs to be able to rely on them existing, which Android can not do to the same degree (see
this post for details).
But if a killer app was designed to run on as many cores as possible you would see an immediate rush of people clamoring for a quad core phone.
Yes, but only if no dual-core SoC exists, that is capable of running that thread-friendly app just as fast, with the added benefit of running those apps with two or less threads even faster. As I've explained multiple times, that is the situation we can expect to encounter in the smartphone space for the foreseeable future, because all smartphone SoC's are constrained to the same power and thermal restrictions no matter how many cores they have. Read my thread above for more info.