Maintain high affection and interact with him at the Library. Kissing him before the final duel locks in his route and closes all others.