If a customer is on holiday, their IP address isn’t the one that’s incorrect, because VAT should be charged based on where the customer is at the time the order is placed, not where they live or where they bank. I’m afraid there’s no reliable evidence at all that you can get on where your customers actually are, as IP addresses can easily be spoofed by VPN or proxy services.