As long as your threat model doesn't require you have these device identifiers be anonymous, then it's completely fine. You will still see immediate improvements in your data privacy as a whole by switching. Even if you didn't play with any of the privacy toggles/options, the base design of the OS, and how it plays with Google Services, is infinitely better than standard Android OSes from a privacy perspective.
I literally bought my phone on eBay and stuck my KYC sim in it. I'm not worried about it personally, but I'm also a normie with no special threat model.