Well as psycorp alluded to before, it depends somewhat on how you use the phone. I mostly experience the issue scrolling through the People Hub. But in your regular day-to-day navigation, making a call, checking a text, quick check of an app.. you'll barely experience it. The People Hub is mostly how I surf Twitter, so I'm in it for several minutes at a time. Should explain why that's where I mostly experience the bug.
Overall, yes I recommend the device. It's the best Windows Phone offering. The battery life reminds me of the dumb phones of yesterday year (Nokias for example) that go 2-3 days without a charge. Everything is snappy, and I do mean everything. It's a good feeling knowing you can do whatever you want and not have to think/worry about whether or not you'll have access to charging the phone and whether you'll need to conserve battery. Of course, it's also sleek and beautiful.
To put it differently, the only other phones I'd consider are the 930 and the Xperia Z 2. This should tell you that I think highly enough of the phone to only ever consider 2 others despite the swipe/tap bug. 930 has no glance and is slightly too small (would rather around 5.5" for the display). The Z2 is beautiful, but I'll miss wireless charging and Windows Phone.
If you're planning to take advantage of what it has to offer, and not just use it as you would much less capable smartphones, then its worth it despite the swipe/tap bug. I stream quite a bit of video while I'm out and about on this thing. Also, my touchscreen type accuracy has gotten a lot better given the size of the keyboard.
In short, with quite a few people clamoring for a 1520.3, it would be easy for me to sell and probably even make money off of the device. So far I apparently like it enough not to do that.