Removing Sticky Labels and Glue Residue from Jars First I soaked the jars in some warm soapy water for around 30 minutes. Most of the paper labels came off after this time but some sticky labels took longer and I had to leave them soaking in the sink for a few hours. Once the paper part of the label was removed I dried the jars and made up a paste of cooking oil and baking soda.