He stood up with a slight bow and left the room.

Since someone came with a direct challenge, he had to accept it.

Otherwise, it would be an insult to his training all these years.