5489 search results - page 150 / 1098 » Evaluating evaluation measure stability |
138
click to vote
INTERACT
2003
15 years 7 months ago
2003
: If multiple evaluators analyse the outcomes of a single user test, the agreement between their lists of identified usability problems tends to be limited. This is called the ‘e...
171
click to vote
LREC
2010
15 years 8 months ago
2010
We present the methodology that underlies new metrics for semantic machine translation evaluation that we are developing. Unlike widely-used lexical and n-gram based MT evaluation...
160
click to vote
ICCBR
2010
Springer
15 years 5 months ago
2010
Springer
The need for automated text evaluation is common to several AI disciplines. In this work, we explore the use of Machine Translation (MT) evaluation metrics for Textual Case Based R...
169
click to vote
TASLP
2010
15 years 4 months ago
2010
Abstract—Automatic summarization evaluation is very important to the development of summarization systems. In text summarization, ROUGE has been shown to correlate well with huma...
151
click to vote
SIGIR
2006
ACM
16 years 13 days ago
2006
ACM
Accurate estimation of information retrieval evaluation metrics such as average precision require large sets of relevance judgments. Building sets large enough for evaluation of r...