Seol mar théacs é seo: Polarization memory in the nonpolar magnetic ground state of multiferroic CuFeO2