My Windows password contains upper and lower case letters as well as numbers, but I am offered only a phone key pad to enter these on, which does not permit capital letters.
Your voicemail password is setup through your phone company. It only accepts numbers for your password/pin. If you do not know your pin, contact your phone company.