Discussion: The FBI Says Its Photo Analysis Is Scientific Evidence. Scientists Disagree

Eyewitness testimony is STILL the worst form of evidence.

I’d take picture analysis over it, any day.

2 Likes

Thank you Josh and TPM for your partnership with ProPublica!! Their ongoing research and reporting on the criminal justice system has been breathtaking and deeply distrubing.

Last year, a federal study determined that professional image examiners matched faces more accurately than untrained students

Raise your hand if this makes you more confident in the process? Would you be willing to stake the rest of your free life on ‘more accurately than untrained students?’ Christ.

9 Likes

The shortcomings of eyewitness evidence does nothing to increase the validity of false technical testimony.

9 Likes

The problems with the FBI’s photo comparison work plague other subjective types of forensic science, such as fingerprint analysis, microscopic hair fiber examination and handwriting analysis, said Itiel Dror, a neuroscientist who trains U.S. law enforcement on cognitive bias in crime laboratories. Dror is a researcher at University College London, frequently teaching at agencies like the FBI and New York Police Department on ways to minimize personal beliefs from influencing casework.

Even DNA analysis can be swayed by bias, Dror said. But pattern-matching fields like image analysis are especially vulnerable. Image examiners’ lab work is, generally, only seeing if evidence from a suspect “matches” that from a crime scene.

“Many of them are more concerned by what the court accepts as science rather than being motivated by science itself,” Dror said.

This is precisely why we have 28 crime scene analysis shows on television. It’s so that jurors say, “Hey, I saw that shit on CSI: Des Moines! That has to be real!”

6 Likes

Add this to lie detectors and drug-sniffing dogs.

Hey, careful with the drug-sniffing dogs, they’re having to work through their substance abuse issues just like us.

3 Likes

So much bad science

1 Like

About as much confidence as the statement, “Last year a Trump University study determined that professional football players scored more touchdowns in US Bank Stadium than laboratory rats.”

2 Likes

How long before DT and his minions start claiming that Mueller was FBI director in 1997?

Every false conviction means letting to real perpetrators go free. And there is so much good work that could be done in this area, but these jerks discredit it all.

1 Like

I’ve done image analysis – not for the FBI – but for the Innocence Project. Much as my heart ached over these men wasting away unjustly in prison, I had to conclude that the photo “evidence” I was working with could never meet scientific standards of objectivity. It’s all subjective.

@careysub

3 Likes

and no hope of improvement:

https://cen.acs.org/articles/95/i16/US-Justice-Department-ends-forensic-science-advisory-panel.html

1 Like

Examiners had long testified in court that they could determine what fingertip left a print, what gun fired a bullet, which scalp grew a hair “to the exclusion of all others.” Research and exonerations by DNA analysis have repeatedly disproved these claims, and the U.S. Department of Justice no longer allows technicians and scientists from the FBI and other agencies to make such unequivocal statements, according to new testimony guidelines released last year.

Not to mention other spurious “absolute scientific proof” put out there by the FBI like bite mark evidence on human skin being an “exact match” to a person. The FBI has been using this pseudo-scientific crap for decades and it has been played up so much in the media it has become a point of absolute belief for many people… Carpet fibers, a single hair, bite marks - they have exploited a gullible public and an ill-informed justice system for years by putting a scientific veneer of authenticity on what is basically voodoo. They have never let anything like actual science get in the way of a good conviction.

1 Like

I’d add evidence from fires to this laundry list. What our justice system needs is multiple double-blind studies examining and either upholding or refuting these claims. @paulw is right.

On the other hand, can an ordinary citizen, say a member of a grand jury or trial jury, question those findings in a meaningful way so they don’t become part of the record when the subject is found guilty and has to appeal?

and @alyoshakaramazov1 Deuteronomy 19:15 Even the old Hebrews knew that: “One witness shall not rise up against a man for any iniquity, or for any sin, in any sin that he sinneth; at the mouth of two witnesses, or at the mouth of three witnesses, shall a matter be established.”

2 Likes

DNA analysis is also extremely flawed. It should pretty much only be used to exculpate, or to support other evidence, not to make false claims of 1 in more-humans-than-have-ever-lived probabilities of identification.

All of the enormous numbers, for example, assume that the potential suspects aren’t part of any kind of genetic subgroup. Which is often, uh, counterfactual. And they still really don’t have enough samples for good stats…

It was much worse in the beginning, but it’s still not great.

1 Like

What!?! I thought that this photo analysis stuff was all rock-solid. I must have been misled.