If your phone is on windows phone 8.1, then you can delete any files that whatsapp saves by going to the whatsapp folder and deleting them there. you can install a file manager app for this purpose or connect your phone to the pc. The whatsapp folder is in the pictures folder
Same with windows 10 mobile but file manager app is already installed for you