Thranos But if I fix it without VPN, wouldn't it attach my IP/imei to the signal-account?
It's clear you are trying to use GrapheneOS as a vehicle for improving your privacy, which is a great idea. But effectively increasing privacy requires detailed understanding (and tradeoffs). There is no such thing as "IP/IMEI"; they are very different. A phone's IMEI is a mostly-permanent identifier for the phone itself. A phone's IP address is a non-fixed, very-changeable identifier for the phone's network presence.
Most Android apps can't learn a device's IMEI (I think that for Google Messages to use the RCS protocol on some carriers it is necessary for Google Messages and maybe Google Play to have access to the device's IMEI). Changing a phone's IP address is as easy as going to a public Wi-Fi network (coffee shop, library, etc.).
I don't have WhatsApp, Telegram, or Signal on my GrapheneOS phone, so I can't provide advice (hopefully others can). But you might experiment with joining a public Wi-Fi network and turning your VPN off.