Switched routers, now lan only accessible via .local

I was using a Google wifi router, and my mac and ipad could connect to my devices on my local network with their hostnames For example, I have a windows computer named jellybox that I host a jellyfin server. in a browser on my mac and ipad, I could just type in jellybox:8096, and it would load just fine. I just bought the Synology RT2600ac, and now the only way I can access local network devices on my mac or ipad is if I type jellybox.local:8096. My Windows 11 computer can access everything on the network without having to add .local to the end. Is there a setting somewhere on the router or my Apple devices that I need to change so that I don't have to type .local to access anything on the local network?