I have had several variations on this situation (not exactly the same set of circumstances). What worked for the most recalcitrant one was:
1. At the command line (elevated), use dir /x to display the folder's short name.
2. Delete from the command line using rd SHORTNAME
I don't know why...