Skyway I understand now. It sounds annoying, but I'd bet that this behavior is a result of an upstream bug (since, to my knowledge, GrapheneOS hasn't changed any related code). There are many bugs like this but they sometimes aren't fixed quickly or at all by upstream AOSP.
You could open an issue in the GrapheneOS issue tracker here, but I think it's unlikely that GrapheneOS developers will fix this issue since they're busy with other projects. Though, since it sounds like it's a new issue, maybe Google will notice a recent change on their end caused this bug and they may already be aware of it.