Merlin would agree about the knights - that's one of the reasons he gave Sebastian shelter: doing something to annoy Kay and the others seemed like a fun idea at the time. That, and well. He didn't quite mind the company, on the contrary.

"Nonsense," the wizard replies from the kitchen. "A hermit likes his quiet."

There's evident fondness in his voice.