During implicit learning, the authors find that sensory representations in mouse auditory cortex evolve over time, rotating into orthogonal memory representations. This allows short-term memories to avoid interference from new sensory inputs.