The Journalism Benchmark Cookbook: We prototyped a benchmark evaluating the task of information extraction in journalism. (Charlotte Li, Jeremy Gilbert, Nicholas Diakopoulos, Generative AI in the Newsroom)
Summary
- A modular, adaptable benchmark for evaluating AI in journalism.
- Focuses on core journalistic values like accuracy, uncertainty, and timeliness.
- Leverages professional judgment and open-source data for practical, reusable evaluations.
