Zeno make sure you allow fullscreen notifications for Clock app
Settings > Apps > Special app access > Full-screen notifications > Clock
to make it work when locked. Volume buttons only work with locked device, not when it's unlocked. Perhaps this is deliberate to not interfere with volume control.