Quality checks
Summaries
- Summaries written
- 494
- Sentences published
- 3257
- Sentences rejected
- 76
- Summaries checked again (2%)
- 9
- Summaries withdrawn
- 0
Why sentences were rejected
| Rule | Sentences |
|---|---|
| No citation of an article | 26 |
| Drops the source’s «σύμφωνα με» (‘according to’) | 18 |
| Names an outlet it does not cite | 16 |
| Claims which or how many outlets report something | 11 |
| Drops the source’s «φέρεται» (‘reportedly’) | 3 |
| Drops the source’s «όπως φαίνεται» (‘apparently’) | 2 |
Latest faithfulness measurement
In a random sample of 50 summaries, a second model (Claude Opus) read the articles in full and judged 232 sentences: 98.7% are fully supported by the articles they cite. Our target is 98%.
- Fully supported
- 229
- Partly (e.g. a detail that is not in the article)
- 3
- Not supported
- 0
- Summaries judged not neutral
- 0