You won't lose Gamerscore. When you earn those achievements, they're yours for as long as you keep the Microsoft Account active.
When you're done with a game, you can go ahead and deleted it. If you want to pick up more gamer points for a title you've deleted, then you're free to reinstall and add any achievements you've missed.