It's not vulnerable when the state of the device is locked. That should be the state when someone unauthorized gets access to your device.
I got used to attach my USB-C headphones after unlocking. It's a price you have to pay for security.
I'd prefer the good old audio Jack.