Tags/Categories visible to users with premisions

I wonder if there is any way to make chosen Tags/Categories visible or invisible to users based on there, premisions for example.
I have product tags that separate products in two groups A and B I want group A visible to one user group and B to second. Is it posible?