If youÂ’re late registering for VAT, you might face delays in getting your tax number, which is needed for issuing tax invoices and claiming VAT refunds. You could also miss out on reclaiming VAT on your business purchases, which might increase your costs.