yourmother I would personally suggest leaving the microphone toggle enabled. You can give apps one time only access to the microphone, as and when you need to use it. This works very well, and gives you control of when and for what reason apps can use that permission.
Additionally, every time the microphone, camera or location permissions are used, you'll see a green indicator dot in the top right corner or the screen. I also recommend using the privacy manager to check which apps have access to the microphone, and the privacy dashboard to check all microphone permission requests.