I came across this fantastic paper after reading about Meehl‘s 1954 book, “Clinical vs. Statistical Prediction: A Theoretical Analysis and a Review of the Evidence”. It’s a meta-analysis (review of studies) of the evidence that mechanical prediction techniques like fixed questionnaires or algorithm generate superior predictions compared with those made by clinicians, regardless of their level of expertise.
In plain words, it suggests that simple questionnaires and algorithms arrive in more accurate predictions compared with clinicians, doctors or psychologists. I can’t believe this is not mandatory reading in every university.
The process of making judgments and decisions requires a method for combining data. To compare the accuracy of clinical and mechanical (formal, statistical) data-combination techniques, we performed a meta-analysis on studies of human health and behavior. On average, mechanical-prediction techniques were about 10% more accurate than clinical predictions. Depending on the specific analysis, mechanical prediction substantially outperformed clinical prediction in 33%-47% of studies examined. Although clinical predictions were often as accurate as mechanical predictions, in only a few studies (6%-16%) were they substantially more accurate. Superiority for mechanical-prediction techniques was consistent, regardless of the judgment task, type of judges, judges’ amounts of experience, or the types of data being combined. Clinical predictions performed relatively less well when predictors included clinical interview data. These data indicate that mechanical predictions of human behaviors are equal or superior to clinical prediction methods for a wide range of circumstances.
The full article is available here: