Invia SMS: Engineering a noise-free quantum memory for temporal mode manipulation