why is my apple watch still in downtime even though my phone isnt

I wake up early to go to the gym and I can’t even use my watch because it won’t get out of downtime until 7am. I’ve changed my settings for my sleep schedule, I’ve updated both my watch and phone and it still won’t disable even though downtime is OFF on my phone settings!!! Please help