This is not just a Night Light issue, this is a "scheduled modes change display" issue. I don't use Night Light, I use greyscale and dark mode scheduled for the night, in the morning dark mode turns off but greyscale remains.
I have to manually turn on the night display mode and then turn it off manually and then it works.