I don't think the gains are 'permanent' but as long as the muscle stays stimulated, it can remain.

And like burly said, if you stop lifting and lose the size, coming back to the gym will restart the growth.