Quantitative Intuition II: The Bayesian Brain’s Achilles Heel

In a previous posting (“Quantitative Intuition: It’s Not Counterintuitive”) I described some of the advancements that have been made in bringing together the disparate worlds of quantitative methods and human intuition, ending on the rather happy note that advanced scientific micromarketing models today are capable of introducing qualitative human judgment and experience into quantitative models, such that the models are able to “learn” from humans about important factors such as competitive threats, nuanced negotiation strategies and even meteorological vagaries – factors that traditionally have been difficult to crunch into the binary 1s and 0s of machine language.  The human brain works in a hierarchical manner, embedding propositions within propositions to think a potentially infinite number of thoughts.   In the example I used in the last posting, a sales rep who reads about a national wholesaler coming to town to open a discount distribution center can nearly instantaneously form a series of mental propositions to evaluate the importance of that news and the probability of potential outcomes that may (or may not) require decisive competitive action from the sales rep’s firm.

Looking at the human mind this way, as a machine constantly evaluating possible outcomes based on prior knowledge and assigning probability weights to those outcomes, gave rise to the notion of the “Bayesian brain,” a term popularized in 1983 by Geoffrey Hinton of the University of Toronto and Terry Sejnowski of Johns Hopkins University.  This notion has subsequently received a good amount of validation by neuroscientists as they continue to make advances in understanding how the brain really works.  Neuroscientists Alexandre Pouget and David Knill of the University of Rochester in 2004 referred to a “growing body of evidence that human perceptual computations are ‘Bayes optimal’ (“The Bayesian brain: the role of uncertainty in neural coding and computation,” Trends in Neurosciences, vol 27 issue 12, December 2004, pp 712-719).  That’s a fancy way of saying that we make estimations based on likelihood – for example we routinely make estimations about things like the distance from us of an object, or the speed at which it is traveling, based on our prior knowledge of the shape, clarity and movement patterns of such objects and the likelihood that the present reality fits into that a priori knowledge.

So far, so good.  But there is an Achilles heel to our hierarchical mental gymnastics.  Briefly, we may be great at the kind of proposition-within-proposition reasoning that our sales rep exhibited in getting to the essence of the competitive threat posed by the wholesaler’s move to town.  But we humans are generally pretty lame when it comes to computation.  Our intuitive reasoning skills fail at the task of instantaneously calculating that 34 x 57 X 71 = 137,598.  One way that we get around this failing is through heuristics – basically, shortcuts that we use in conditions of uncertainty to help us get from information to evaluation and decision.  Take the example above of evaluating the distance a particular object might be from us.  Now, there is a physics formula we could apply to measuring distance, height, momentum (if moving) and so forth to give us the precise answer as to how far away that bicyclist in the yellow jersey is from us.  But our brains lack the ability to do spontaneous physics equations.  Even if we precisely knew one or more of the variables it would be hard to do an on-the-spot computation.  So we need something else – a proxy, a heuristic.  That something might be clarity.  Can we see the bicyclist clearly?  Can we make out the details of his black helmet with red stripes, and the ‘Elf Aquitaine’ logo on the yellow jersey?  That can give us enough information to call upon our “cyclist in a yellow jersey” neuronal connections and infer a likelihood that he is, say, 50 yards away.

The problem with heuristics is that they are subject to error: not occasional lapses in judgment but systematic, predictable biases.  For example if we use clarity as a heuristic we may overestimate the distance of that cyclist from us if there is poor visibility.  Understanding the role of heuristic errors in human judgment and decision making was one of the main contributions of Amos Tversky and Daniel Kahneman to our understanding of behavioral factors in human decision-making (“Judgment Under Uncertainty: Heuristics and Biases,” Science New Series vol 185 no. 4157 Sep 1974 pp 1124-1131).  Tversky and Kahneman documented specific heuristic errors such as representativeness (drawing broad or sweeping conclusions from a limited data set), availability (assigning the likelihood of an event based on the easiest example that comes to mind, whether or not appropriate, and anchoring (relying heavily on one piece of information when making a decision even if it is irrelevant).

Since heuristic errors are part and parcel of human judgment and decision-making under uncertainty, we have to take this reality into account when we attempt to integrate quantitative modeling methods and qualitative human judgment.  What are the best mathematical tools and frameworks to integrate these two domains?  One area in which we at Sentrana are spending considerable time is that of Bayesian hierarchical modeling. The Bayesian approach is particularly useful in marketing situations such as modeling differences in the needs and wants of customers using both generalized and conditional assumptions involving multiple variables. Bayesian frameworks provide a natural way to pool disparate sources of information. A Bayesian model requires the formulation of prior distributions and the estimation of a likelihood function, which can add complexity to the model-building process.  However we expect future insights and innovations in this area, alongside the development of more robust computation capabilities to bring more firepower to bear on this difficult but potentially valuable quantitative approach.

Subscribe   |