Titan_M2 I'm not sure, but allow me to provide some more information which might give some clues.
I am not sure if you have WhatsApp installed: if you do it's a little easier to follow this.
Open the App info for WhatsApp > Permissions > 3 dots > All permissions. Under Contacts, you will notice the permission "find accounts on the device".
Therefore it seems the contacts permission on Android includes more than just your address book, which may explain why Contact Scopes are not sufficient.
It seems that this permission only gets properly granted, and allows Google Play Services to check the Google account on your device, if and only if both WhatsApp and Google Play Services have the contacts permission.
This set-up seems to be specific to the way that WhatsApp requests the accounts on the device, because I have used other apps which backup to Google Drive via a Google account on my device, and have not needed the full contacts permission, and nor has Google Play Services. Cryptomator is one such app that comes to mind.