I'm reading On Intelligence by Jeff Hawkins, which is about how the human brain thinks (with the angle of replicating this as artificial intelligence).<p>In brief, the neocortex has layers. Inputs from senses arrive at the lowest layer, and the data is propagated upwards through the layers to the top, where inputs from different senses are combined and - simplifying my already simple understanding massively - decisions are made. At the lowest layer of the hierarchy, if it is a visual input, it could be a fragment of a line. This could be combined with neighboring inputs to be an eye, and with more inputs, even further up the hierarchy, to be the face you're looking at.<p>Importantly, data runs down the hierarchy too. This is your brain making predictions of what to see, hear, feel, etc. Suppose someone says "my hands are cold so I'll put on my dloves" (not a typo). Say this to an English speaker and they will hear "gloves"; their mind has predicted the word "gloves" from context and experience (some Eastern European speakers won't be fooled, since their languages do have the "dl" sound). Or if you're listening to a song, your mind is primed to hear the next note at the right time. If I understand it correctly, cortical columns in some regions basically transmit the signal "song going as expected" - just passing up a summary, not the details. If you hear a wrong note, the prediction fails, and the details get passed up to the next layers instead.<p>It occurs to me that some of the abilities described might be the result of impairing the prediction mechanism. Qualities of autistic people/savants/TMS-enhanced people were mentioned in the article:
-Being unable to recognize the same area when subtle details like shadows were altered.
-Being able to draw accurately
-Being able to count hundreds of matchsticks.<p>As mentioned in other comments, accurate drawing requires us to <i>not</i> use the mental categorization we're so used to. Without the prediction mechanism, maybe the details of the inputs propagate higher in the hierarchy, closer to what we might consider consciousness. Similarly, counting matchsticks might require us not to group a heap of matchsticks into "a heap of matchsticks" but instead still see each individual matchstick.<p>But I Am Not A Neurologist.