How do I cancel an Apple Pay account

A few weeks ago a criminal setup an Apple Pay account in my name and attempted fraudulent use of my money. Fortunately, my bank identified the improper activity and cancelled the debit card involved and arranged to send me a replacement card. Unfortunately, there is an automated system that provides the new card details to accounts such as Apple Pay.

The criminal then used Apple Pay for further fraudulent activity using the new debit card; I may add that at this stage I had not yet received this replacement card.

The bank has now cancelled the second card and provided a further replacement, but they tell me that there is no way to prevent their automated system from providing the new card details to registered third parties such as Apple Pay.

This is a crazy and dangerous system and I have made a formal complaint to my bank but I have little faith in them taking remedial action and close the loophole that automatically provides card details after fraudulent activity.

I would like to close the Apple Pay account setup in my name but I do not have any Apple devices that appear to be the only way into this system. Can anyone provide a solution to my problem?