Sciweavers

2008 search results - page 188 / 402
» MUC-4 evaluation metrics
Sort
View
ACL
2007
15 years 8 months ago
Corpus Effects on the Evaluation of Automated Transliteration Systems
Most current machine transliteration systems employ a corpus of known sourcetarget word pairs to train their system, and typically evaluate their systems on a similar corpus. In t...
Sarvnaz Karimi, Andrew Turpin, Falk Scholer
LREC
2010
174views Education» more  LREC 2010»
15 years 8 months ago
SINotas: the Evaluation of a NLG Application
SINotas is a data-to-text NLG application intended to produce short textual reports on students'academic performance from a database conveying their grades, weekly attendance...
Roberto P. A. Araujo, Rafael L. de Oliveira, Eder ...
LREC
2008
87views Education» more  LREC 2008»
15 years 8 months ago
Translation Adequacy and Preference Evaluation Tool (TAP-ET)
Evaluation of Machine Translation (MT) technology is often tied to the requirement for tedious manual judgments of translation quality. While automated MT metrology continues to b...
Mark A. Przybocki, Kay Peterson, Sebastien Bronsar...
LREC
2008
139views Education» more  LREC 2008»
15 years 8 months ago
Automatic Learning and Evaluation of User-Centered Objective Functions for Dialogue System Optimisation
The ultimate goal when building dialogue systems is to satisfy the needs of real users, but quality assurance for dialogue strategies is a non-trivial problem. The applied evaluat...
Verena Rieser, Oliver Lemon
NAACL
2004
15 years 8 months ago
A Probabilistic Rasch Analysis of Question Answering Evaluations
The field of Psychometrics routinely grapples with the question of what it means to measure the inherent ability of an organism to perform a given task, and for the last forty yea...
Rense Lange, Juan Moran, Warren R. Greiff, Lisa Fe...