I think the sad truth is that that is societies ideal. The guy in the class or meeting who rattles facts and numbers off from memory is generally considered smarter than the guy leafing through his notes. As long as the the memory guy is speaks confidently, people seem to forget that he's more often wrong than the guy reading accurately from his notes.

At least that's what I notice - as a guy with a memory like a sieve.