Extract from Melina Efstathiou’s article, “Homenum Reviewlio.”
Two weeks ago I wrote about a label, “deterministic”, used as a cape. Last week I wrote about a number, recall, and the person who can produce it when asked. This is the third spell. And it is about the thing both of those depend on: The baseline.
In Harry Potter, Homenum Revelio reveals any human who happens to be nearby. This piece does the same for document review, because there is one participant in almost every comparison between humans and machines who is rarely asked for any numbers at all: The human reviewer.
The reviewer nobody scores
When generative AI is used in review, we ask it for precision, recall and elusion. We ask how the sample was drawn, how large it was and what the interval looks like. These are reasonable questions and I have argued that anyone using the technology should be able to answer them.
