How to remove labels from plastic pill bottles | Hometalk Soak with rubbing alcohol and rub them off. The alcohol dissolves the glue. Vimarhonor on Nov 20, 2017 Mine pull off easily- but I do have to remove the adhesive residue with lighter fluid. Ann|The Apple Street Cottage on Nov 20, 2017 Goo Gone! Sheron on Nov 20, 2017 Try a Hair Dryer first then hot soapy water should remove the glue.