OK.... It changed on my phone, it may be because I updated my Google Play Services through the play store, but you can access it here:
Once your in Google Settings, click on your account profile picture. Might need to be in All Services.
Then under Data and Privacy you'll find those settings.
Also, under All Services, there is the setting "Personalize Using Shared Data," also turn this off.
That's what seems to turn off all this Google data usage activity usage off.
I don't know for sure how Google interconnects your data, but I believe that they use data for convenience features like this because most people like features like this. Good description under Personalize using shared data...
There may be a setting somewhere in manage my account for location sharing too...