RanHerOver the concern, for me at least, is that Play Services requires network permission to deliver those notifications.
This means Play Services will be able to establish a constant connection with your device, which could arguably be used for tracking, analytics, ad delivery, etc. The Firebase Cloud Messaging (FCM) component of Play Services, used by many apps to deliver those notifications, may reveal some of your activities as well.