Experiments in Lawyering: Does the Harvard Legal Aid Bureau Deserve a Merit Badge?

Dave Hoffman

Dave Hoffman is the Murray Shusterman Professor of Transactional and Business Law at Temple Law School. He specializes in law and psychology, contracts, and quantitative analysis of civil procedure. He currently teaches contracts, civil procedure, corporations, and law and economics.

You may also like...

6 Responses

  1. A.J. Sutter says:

    Your last sentence is a non sequitur, either in the absolute sense or at least with regard to the information presented in your post.

    First, where is the “obstruction”? Suppose that, given what they knew at the time, other programs sincerely regarded the randomization experiment as unethical or potentially harmful to their clients. In those circumstances and under that “prior,” wouldn’t it be responsible of them to decline to participate? As for the last group, previously it had advised clients to call HLAB — but those clients might not have called HLAB anyway, or might have found HLAB even without the advice. How did its removal of such advice prevent HLAB from conducting its experiment? No matter what the reason, if I decline to participate in, or otherwise to facilitate, an experiment, am I “obstructing” it? This sounds like a notion from a bad horror or sci-fi movie, where the crazed “genius” complains that those who don’t accede to his designs are “standing in the way of science.”

    Second, what’s the connection between public funds and compliance with a Harvard prof’s experiment? Or have I missed something while spending the Obama Administration abroad — a Cass Sunstein directive, e.g.?

  2. A.J. Sutter says:

    Thanks for the kind shout-out and the reply, Dave. But the point of my Bayesian reference to a prior was that at the time the groups behaved in the way they did, the findings of the research weren’t yet known. So the groups might have reasonably and sincerely concluded that, far from acting in a “self-serving, self-protective” way, they were acting in the best interests of their clients by not depriving them of representation (or exposing them to the perceived risk of non-representation). From the description of the methodology in Greiner/Pattanayak (@18-20), it seems that the researchers were careful to obtain consents from participating claimants; but some of the clinics might reasonably have worried that claimants, who were already stressed by being on unemployment anyway, would not understand the potential impact of their declining to be represented. While some might consider such scruples paternalistic, that doesn’t make the non-participating clinics’ motivation necessarily self-serving or self-protective.

    I’m agnostic about whether the Greiner/Pattanayak research is conclusive enough to change that “prior” from this point forward, but projecting it backwards seems like an unfair use of hindsight.

  3. James M says:

    I think the study shows something else – that to be effective you need representation by someone who knows and ins familiar with both the relevant law and the administrative process used to determine the outcome.

    I see lots of lawyers jumping in to help with the tide of foreclosures, but without a specialization and prior experience in foreclosure defenses they are infective. They frequently make the sort of mistakes that pro-se defendants make, and frequently don’t use the legal defenses and strategies that an experenced foreclosure defense firm would do.

    I have not seen the raw data from the study, but I suspect a better comparison would be the outcomes of cases where the person was represented by good quality counsel with a track record, compared with pro-se.

    It goes to show the need for effective knowledge, either through personal knowlage and experience or systematized into detailed checklists.

    Airlines don’t crash very often, becuase the pilots have been well trained AND becuase everyone involved is working from pre-flight checklists which makes sure everything is done. Lawyers like to think they know it all and frequently don’t have speclised training on that specific legal process and don’t implement or use checklists.

    Some do know it all, most don’t.

    They don’t even know what they don’t know, don’t even know why they fail.

    If some lawyers do have better than average track records in this sort of proceeding, the relevant question is WHY are the lawyers involved getting it wrong?

  4. Jim Greiner says:

    Hi, Dave, thanks very much for the shout-out re the paper. Two quick thoughts. First, re the question of claimants randomized to no offer of law student representation (and whether these claimants got representation from another source), it might be worth a review of pages 37-41 of the currently posted draft, where tackle that issue. No doubt many will be disappointed by the fact that the data would not support more definitive results (we’re disappointed ourselves), but we report what we see.

    Second, I think the Harvard students’ decision to participate in the research really was quite courageous. We have approached other legal services providers to suggest randomized evaluations; the responses have varied, but it’s not much of an exaggeration to say that the modal response has been the finger. Without going into too much detail re Harvard Law structure, the students involved here run their own law office, and they were under no obligation whatsoever to participate in the research (they initially turned us down). As Ian Ayres suggests over at the Freakonomics blog, the only way to expand the use of randomized trials (and to benefit from the knowledge they provide) is to support those entities brave enough to engage in them.

  5. I am not an academic and I have to confess none of this made any sense to me. The paper evaluated whether an offer of representation, not actual representation made a difference. So how were the Harvard students courageous? The test didn’t evaluate work they actually did.

    I also think that selecting unemployment compensation hearings in the midst of an economic downturn as a basis for evaluating effectiveness of representation was probably not a very smart choice. My guess is that ALJs are extremely sympathetic to unemployment claims in a recession and a lawyer probably would not make much of a difference. Why didn’t you examine the effectiveness of representation in foreclosure proceedings? Or debt collection cases? To me, that would have made much more sense.

  6. Frank says:

    Carolyn, the authors took pains to point out that they didn’t have many options–they need the clinic’s cooperation after all.

    I agree that outcomes in this sort of proceeding seems less likely to benefit from lawyers. Heck, if I were an ALJ, I would have a hard time ignoring the fact that most 3L Harvard students before me are likely to draw double my salary in on year’s time.

    But if it’s obvious to you that clinical students make no difference in this sort of proceeding, and since the study tends to confirm that view, isn’t the real question: “Why does Harvard commit so much time and money to a clinic that doesn’t actually help the poor?”