Learn From the Past, Enhance for the Future