You nailed it ….. Just get away from Google altogether.
I must add that I do this with two phones, the Google phone never leaves my residence, and the other one goes out into the real world with me. I use the free Proton VPN on both.
I’m really not naive enough to think I can really hide, but at least Google doesn’t know who I am, where I am, or what I am doing.
(Get stuffed, Google)