What a hatchet job.<p>Unfortunately we don't have the raw data available; but all we can infer from these heatmaps is that yes (and exactly as one would expect) there's a bit of variance between between the two sets of ratings (in both directions). Maybe a bit more than can be explained by the sample size, or from the simple fact people (on both sides of the process) are forced to discretize their assessments (so even if both parties were to objectively agree that the "real" performance was in the 2.4-2.7 range, which it is a good chunk of the time.... inevitably you'll find them be off by +/- 1 in their quantile assignments a good chunk of the time -- which is exactly what the data seem to show).<p>In particular: independent of how we explain the variance (whether due to sampling effects, or bona fide DK/IS) note that the vast majority of the variance is in the +/- 1 range. And on the alleged DK side (-2 variance) the measure is apparently quite miniscule.<p>However, that's not the original D-K effect. What D-K specifically predicted (and were able to show with much better data and methodology -- in their very specific sample population, at least) is that, <i>among the general population</i> there will be a striking degree of -2 variance, specifically in the bottom quartile. Going by the oft-quoted abstract from their original paper:<p><i>Across 4 studies, the authors found that participants scoring in the bottom quartile on tests of humor, grammar, and logic grossly overestimated their test performance and ability. Although their test scores put them in the 12th percentile, they estimated themselves to be in the 62nd.</i><p>In other words: "Performers in the bottom quartile estimated themselves to be performing, on average, at mean performance in the third quartile."<p>So if were to look for something analogous to a D-K effect, we'd expect to find a "hot spot" (or at least the strongest amount of red ink, for that quartile) in the upper left of the first chart.<p>Instead we find most performers in the bottom quartile (correctly) identifying themselves as in the bottom quartile; with a smaller portion bleeding up into the second quarter; and an an almost negligible portion placing themselves in the D-K zone -- namely, the third quarter.<p>If anything what the data show is that (even assuming there's nothing to contend with in how the actual data were taken), while inevitably there's some variance (both ways) in the two sets of rankings, and probably some of due to distorted self-perception -- on the whole there's actually <i>much less</i> of a D-K effect among engineers than among the general population (or rather, "Cornell undergraduates taking psychology classes" -- which, lest we forget, were the actual subject class used in the original D-K study).<p>So basically the opposite of what the author of the original article is claiming to infer from this data.