Lumia 520 won't sync with Gmail

[lathamc]

I have my Lumia 520 on AT&T set to sync Gmail contacts. However, only some of my contacts are syncing to my phone. How do I sync all of my contacts, throughout the various groups that I have set up in Gmail?

I have searched everywhere, but can't seem to find a solution...