Record · corpus.blog/posts/01a0c544-0d79-710f-b294-8a72bdc69d1a

Ten tips on doing a good evaluation

Ehud Reiter · published 8 April 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at ehudreiter.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 26
Words captured: 1,380

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://www.sciencedirect.com/science/article/pii/S088523082030084X

sciencedirect.com

https://ehudreiter.com/2019/10/08/accuracy-fluency-and-utility/

ehudreiter.com

https://ehudreiter.com/2020/10/20/could-nlg-systems-injure-or-even-kill-people/

ehudreiter.com

https://ehudreiter.com/2020/03/02/why-use-18-year-old-bleu/

ehudreiter.com

Why is ROUGE so popular? Read at the source ↗

ehudreiter.com

Lets use error annotations to evaluate systems! Read at the source ↗

ehudreiter.com

A bad way to measure hallucination Read at the source ↗

ehudreiter.com

https://ehudreiter.com/2017/05/09/weathergov/

ehudreiter.com

Summarisation datasets should contain summaries! Read at the source ↗

ehudreiter.com

https://ehudreiter.com/2019/08/01/do-we-encourage-inappropriate-data-sets/

ehudreiter.com

https://ehudreiter.com/2018/08/30/use-proper-baselines/

ehudreiter.com

I’m very worried about data contamination Read at the source ↗

ehudreiter.com

https://ehudreiter.com/2020/02/06/cheat-by-overfitting-test-data/

ehudreiter.com

https://lakens.github.io/statistical_inferences/

lakens.github.io

https://aclanthology.org/P18-1128/

aclanthology.org

https://ehudreiter.com/2018/01/29/two-tailed-p-values/

ehudreiter.com

https://ehudreiter.com/2017/05/18/regression-to-mean/

ehudreiter.com

https://ehudreiter.com/2019/03/07/good-records-of-experimen

ehudreiter.com

Unresponsive Authors and Experimental Flaws Read at the source ↗

ehudreiter.com

Common Flaws in NLP Evaluation Experiments Read at the source ↗

ehudreiter.com

https://ehudreiter.com/2020/09/25/please-check-boring-details/

ehudreiter.com

Quality assurance for academic research Read at the source ↗

ehudreiter.com

Peer Review Has Improved My Papers Read at the source ↗

ehudreiter.com

Limits of pre-publication reviewing Read at the source ↗

ehudreiter.com

ACL vs TACL Reviewing Read at the source ↗

ehudreiter.com

Exercise: Find Problems in an Evaluation Read at the source ↗

ehudreiter.com