Ladida I wish there was a possibility to sync to the GPS signal
I see this you raised this issue in a separate thread: https://discuss.grapheneos.org/d/29445-how-to-gps-time-sync-device-drifting-in-airplane-mode.
One potential problem is that some VPN implementations depend on some degree of time accuracy. For example, Unreliable Monotonic Counter is one of the documented Known Limitations of WireGuard. More details are in the WireGuard paper. If a WireGuard peer's time drifts forwards or backwards, that can cause connection issues when establishing the tunnel. This can be more apparent if multiple devices, with different degrees of clock reliability, share the same WireGuard peer configuration (same identity/key).
There are multiple reports in this thread. It would be helpful to know if the GrapheneOS device can access the internet while the issue is occurring. This is one possible explanation:
A Pixel 9a, which has some reports of clock drift, is powered off and loses its time accuracy. The device is powered on and the Always-on VPN attempts to connect. Because of the inaccurate time, a VPN connection such as WireGuard can't be established. This means the device is effectively without network access and the GrapheneOS HttpsTimeClient can't receive time update data.
The way to fix that scenario would be to set the time manually or to temporarily disable the VPN. Depending on the amount of drift, it may be possible to just wait long enough for clock to catch up to the last valid WireGuard monotonic counter value.