italian_job when an app prompts you for the contacts permission, there's a "setup contact scopes" button, which allows you to enable contact scopes for that app, and then add contacts you want for it to access.
If you've already granted an app that permission, you need to go to Settings > Apps > app you want to give contact scopes to > Permissions > Contacts > deny it and press Contact Scopes.