I have the same issue. We have some Amazon Echo's and they were linked to my Apple Music. So my Replay has a bunch of kid songs that I don't want. Unfortunately it's not possible to remove songs from the Replay itself. But here's kind of a workaround:
1: Open Replay 2024 in Apple Music on your phone
2: Click on the 3 dots at the top right
3: Click "Add to a Playlist..."
4: Select "New Playlist". This is important! Select "New Playlist" and create your own or the next steps won't work
5: Title the playlist anything you want and click "Create" at the top. I called mine Replay 24
6: Now select "Library" at the bottom of Apple Music
7: Select "Playlists" and scroll down to find your new "Replay 24" Playlist and select it to open it
8: In the new playlist you can go through and delete any unwanted songs by clicking on the three dots next to the song you don't want and select "Remove from Playlist"
Now your Replay 24 Playlist will be free of anything you don't want. Hope this helps.