I agree that it's annoying but I think Google Cloud and other cloud providers also does this thing where you need to configure a new billing information to delete the original one. As an alternative you could create one of those virtual cards and then cancel it, i guess.