There is no such thing as truly "live and let live". If that's the case, it would be lawless.
What may be more acceptable is people just follow the laws...and to write (and enforce) the laws in such a way everyone is guaranteed certain basic rights that are free of social (slavery based) bias.
I live in "a post modern society" where my skin tone (which is based in biology) has certain social baggages (defined by other people for inequality purposes). I'm not in a position to wax poetic on this reality: I can encounter individuals in jobs with a certain level of authority (example, police) with certain bias that can lean on a combination of certain colonial privileges and how they feel that day TO USE EITHER LEGAL POWERS OR LEGAL FORCE TO RUIN MY LIFE AT MINIMUM OR END MY LIFE AT WORST no matter how COMPLIANT I am, no matter WHERE I am.
I don't have to make that up. Many others who look like me experience a similar reality.
Unless people who do not or think they cannot (but aren't really exempt) experience reality are willing to just shut up (no what about isms) and acknowledge that stuff exists, then we won't get anywhere. People need to stop hiding behind their privilege, whether real or perceived.