hamedi Thanks for the VPN tip!
It works much faster. Kind of strange...
Might be an issue how data is routed between your location and GrapheneOS server, it might go over a very slow link at one point. Routing it between you and the VPN, and VPN and GrapheneOS server might avoid that slow link despite technically taking a longer path.
If the issue persists, you might ask your ISP to debug the issue, so they can fix the routing tables to avoid that slow link.