Make sure you use the original "Mains" charger you got with your phone and I would leave it on charge for a few hours. If a battery is completely flat you need time and more power than USB can supply, as the phone will try to start and then the outgoings are more than USB can supply as the phone tries to sync.
Or it could just be a duff battery.