No, to my knowledge what you describes is unfortunately expected behavior.
I assume the app you are referring to is Bluetooth Codec Changer. I use this app with only the "Nearby devices" permission and while I would definitely prefer a native solution or at least a FOOS app, I still prefer using Bluetooth Codec Changer rather than having to go into developer options every time I reconnect my BT headphones.