VAT Tax not removed when choosing Suppliar that dos not have VAT registration

Check the supplier settings and then remove any VAT rule or tax group linked to them so VAT won’t appear on their invoices.