If it annoys you now, it will only get worse (in your mind) over time, which is why i would advice getting a replacement unit.
The sad thing here is, that every Microsoft product I owned had this problem. My first and second Surface 2 as well as my first and second Lumia 830 had the same problem (and others). Isn't the whole replacement process more expensive than a better quality management?
And the other thing I don't get is why people always talk about Apple and MS producing equally "good/perfect" hardware, my experience sadly says otherwise. Better quality would make buying those devices an even greater pleasure, especially in countries without a Microsoft Store (like Europe) where they need ridiculously 4 weeks to replace your unit...
First time buyers will never buy a MS product again, if they can just walk in the next Apple Store and leave with a new unit. If they want more market share than they should invest in retail stores here in Europe.
If u get one, I wish you all the luck with your replacement unit!