How to disable widget access via Digital Crown on my Apple Watch?

With the new 11.1 update, one of the new ways to get to your widgets is to turn the crown. However, now it seems every other time I look at my watch it’s on the widget screen and not the watch screen. So I have to click the crown to get back. How can I disable this feature?

[Re-Titled by Moderator]