A feature from what seems to be either Android 12 or 13 resurfaced on my Android 14.
Basically, the first time you connect to a Wi-Fi network on Airplane mode, it remembers it and connects to it each time you toggle Airplane Mode. How do I disable this? This wasn't the case before.