Colbert is a terrible, terrible interviewer. He asks the most leading questions, while insisting on talking more than the people he's interviewing.
You may be looking too far into it. Colbert purposely trolls everybody he interviews. Some people appreciate his humor much more than others. Matt did pretty, especially compared to when Colbert interviewed Ben Gibbard.