Extract from Sam Bock’s article, “AI Accuracy, Capability, and Reliability: What’s the Difference?”
Before you move into tactical conversations about evaluating legal AI, you’ve got to make sure all your stakeholders are speaking the same language.
This sounds like a given, right? But in practice, a surprising number of AI conversations jump right off the rails because of inconsistent lingo. A litigator asking whether “the AI” is “reliable” and a vendor explaining that “the model performs well” may both be speaking in good faith, but about entirely different things.
For example, here’s a common vocabulary problem watering down AI conversations all over the place: the words “capable,” “reliable,” and “accurate” are often used as though they mean roughly the same thing in the context of AI and its suitability for legal tasks.
