Gravar-mail: Phenotypic memory drives population growth and extinction risk in a noisy environment