I just minimize them. To do that you can: swipe down to get notifications drawer > find the active app > tap and hold > tap gear icon in upper right-hand corner
The notification channel that's causing the notification should be highlighted and flash a bit. You can either turn the notification channel off, or tap the name then turn on "minimize." When minimized the app will still show up in the notification drawer, but not in the status bar.