Make a small paper shim (maybe 3 thicknesses of paper) and put it in the battery well on the end opposite the battery pins. Make another to lay between the battery and the cover. That should sock it tight.
If you need additional help or have more questions or details to share, please join the site so you can reply in this thread. See this link for instructions on how to join Windows Central.