Apple Music song won’t stop playing after closing the app

Everytime I play music on my Apple Music app, then close the app during a song the song continues to play and I can’t stop it from playing. I’ve been having this issue a lot and it even allows me to re open the app and play another song while the other finishes. I have no way of stopping the original song from finishing other then waiting till the end.

[Re-Titled by Moderator]