That depends on the phone if it has a standalone contacts app like Samsung does. If you're using a Pixel/Nokia/Android One device, it has the Google Contacts app by default, so it's really going to to be a bit frustrating since that's primarily designed to sync with Google.