I don't think it is a glitch, or bug at all. If you use something while the seal is on, then that would cause the seal to wear off. But, if you're just doing it outside the cave, nothing would happen. It's like, if you have the quest, and you ate a cupcake outside of the cave. XP