Apple Watch Ultra 1 face keeps returning to compass

I have an apple watch ultra 1 and the watch face just keeps going to the compass face. I've checked in the setting to make sure return to clock is set to always. I've restarted the watch but after a few seconds it goes back to the compass face. It's driving me nucken futs. I think I'll just reset to watch to factory. I don't have patience to wait for a reply or fix here.