From what it looks like, if the picture is inline(embedded or external), it cannot be downloaded. No link or context menu is given. What a bugger.
If the picture is not inline and shows up as an attachment at the bottom, then it can be downloaded.
I gotta say, this is quite an oversight.
The only workaround is to use the webmail client.