at3274 if you "kill" the settings app (i.e. swipe up on it in recents), then open the settings, it won't do it. Nor will it do it if you launch settings via the app icon, instead of the notification tray.
I'm no expert on how android handles things like this, so someone smarter than me will have to pipe in with an explanation, but I wouldn't worry about it.