Do not remove the labels that came with your clothes. You might need them when you come to washing them.
If you are having problems with the label and you feel you must remove it then mark it so it can be identified to that particular item of clothing. Store it in a safe place (near the washing Machine) and it will be there if needed.