- Edited
Safe browsing in standard isn't that privacy invasive as far as I'm aware. But do keep in mind that you still have to share some data even if the data shared is pretty limited. Whether you use it or not is up to you.
Enhanced mode however is quite a bit more invasive. As it will send significantly more information to google. It is however obviously more effective as well. So once again up to you.
Ultimately it depends on how you feel. If you feel you don't need the extra protection and that your browser's actual security is enough then leave safe browsing off to have extra privacy.
If you would rather the extra security over possible privacy implications then turn safe browsing on.
Either way it isn't inherently a bad thing to turn it on or leave it off. All these options have ups and downs and users have preferences. So choose what works for you.