AirPods not working for calls when answering while using YouTube

When I get a phone call while using various apps (especially YouTube) it’s almost impossible to answer the call. I will answer the call from the call banner that pops up and visually the call looks like I answered it but my phone continues to ring and I can’t hear anything even though it shows that the audio source selected is my AirPods. I usually try to switch the audio from the call screen to iPhone and then back to AirPods but then usually I can hear the other person but they can’t hear me. I always end up having to end the call and call the person back. This is not an issue when listening to music. Only when using apps like a YouTube or some game apps. I’ve tried playing around with YouTube settings to see if they had audio priority but I can’t find anything like that. HELP!

[Re-Titled by Moderator]