I'll barge in and say that there's this meme in business schools that: "what gets measured, gets done."<p>They're mostly there to serve as the source of truth, whether or not a specific manager is getting a bonus (and by how much).<p>Generally, the best metrics are "based in reality" (and usually revolve around inflow and outflow of money) -- but those are hard to fudge, without playing accounting games, and even harder to meet (it takes actual skill, rather than being able to pass the buck endlessly for a couple of years, before moving onto another org); so you may find it common for the managerial horde to pick "bullshit metrics" to cover their own asses (doubly so, if the metrics are decided by committee).<p>There's no reason for practical metrics to exist in most large corporations -- the incentives just aren't aligned. Bonuses are decided by metrics (and anyone who has a modicum of intuition, will always pick the metric that can be most gamed for himself, and his underlings). Also, if we're being real with ourselves, there's very little that managers "control," so picking a "real" metric would just breed an environment that selects for luck (or lies).<p>In my opinion, the only useful metric is profit generated. Everything else is just an emotional safety blanket for uncertainty.
> So let's circle back to metrics and ways to ensure we use them for guidance rather than obey them reflexively.<p>I'm not sure this is the right framing of the problem. "Guidance" is too nebulous and leaves us with the same problem of interpretation.<p><pre><code> Advice from an old tracker: You want to find someone, use your eyes.
</code></pre>
When I have someone who is getting themselves/us in trouble by looking at charts, my remedy always includes the notion that charts are for asking questions, not answering them. You might have a chart that says user response time has improved, but have you tried using the service from your phone (with wifi disabled)? If the chart says the times are shifting, we need to know why they are shifting, because that's information. "Looks like response time went down," is only useful as the introduction to a question, like, "did we change something?" or "did we have a routing issue?", or "can we do the same thing on this other service that is drawing complaints?"<p>Getting good questions also often involves cleaning up sources of noise in the charts. It's too easy for someone with an axe to grind to jump to conclusions that this is a repeat of a problem we had before (ie, this is Team X's fault... again) or that lack of improvement means failure to act. It is not impossible that I fix one regression at the same time someone else causes another, or changes the denominator by the same magnitude as the fix.
I don't have much to add other than this reminds me of the obsession around "satisfaction" for product metrics and why that seems to always boil down to slapping NPS on it because it's a number and execs like numbers.<p>I think this is essential reading if anyone's interested on a product-focused tangent for the topic: <a href="https://articles.uie.com/net-promoter-score-considered-harmful-and-what-ux-professionals-can-do-about-it/" rel="nofollow">https://articles.uie.com/net-promoter-score-considered-harmf...</a>
Goodhart's law is often confused with Campbell's law.<p>The two are indeed very similar, and often used interchangeably, but there's an important difference in their phrasing.<p>Goodhart's law states that: "When a measure becomes a target, it ceases to be a good measure."<p>Campbell's law states that: "The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor."<p>In other words, the former focuses on the fact that, while metrics sound good in theory, in practice they cannot be relied on; whereas the latter focuses on the fact that enforcing metrics in an attempt to control a social process tends to backfire.<p>Or, in Trump language:<p>Goodhart = "Sounds good, doesn't work"<p>Campbell = "Worst trade deal ever"
FWIW [from having skimmed] This should be of interest to people interested in UX where there are safety ramifications.<p>Thus, the original article title might be a bit misleading. It is not necessarily about businesses running based upon illusions.
“I'll barge in and say that there's this meme in business schools that: "what gets measured, gets done."” The key is those that sone might not be most useful.