The most practical Bayesian counter (indep of matters of confidence) might be the info bottleneck:

  to generalize accurately, one must forget (irrelevant) details
The risk (bottleneck) is in throwing out the relevant details