The Yusuke knows is the fact this person was a lady away from his early in the day–someone that he cherished and possibly wronged