Right. The post links to slideshow "model" for counterfactuals given at Hulu. And I won't pretend to analyze it scientifically, but it's hard to shake the feeling that it's circular in this application.
We want to rank lawyers based on effect on outcome, not win-loss record. But it looks like the model is one that derives "counterfactual" outcomes by making comparisons based on win-loss records.
Can someone give a better lay-level discussion of the expected outcome model?
-----------------
how exactly did they model the probability of successful outcomes for given cases?
because those depend on highly detailed fact patterns, many of which are largely qualitative in nature
if they were actually able to put all those in a data base that you could then model
that'd be a more interesting accomplishment to read about