jah If you do that, it may ask you again. However, you can install it and then disable it, as GrapheneOS allows you to disable user-installed apps.
That said, I would just install it and leave it there. It's asking you to install it because you likely have an app that can use this as an optional dependency. It's not a malicious app.