Nope, they actually appear and disappear. The idea is that even in vacuum there's a certain amount of background energy and that energy can randomly turn into matter-antimatter pairs in what is basically the inverse of matter-antimatter annihilation.