Shared Task: Results
June 23, in conjunction with ACL 2007 in Prague, Czech Republic
[HOME] [SHARED TASK] | RESULTS | [BASELINE SYSTEM] | [PROCEEDINGS] | [SCHEDULE]
The results of the shared task are summarized in the paper:
-
(Meta-) Evaluation of Machine Translation
Chris Callison-Burch, Cameron Fordyce, Philipp Koehn, Christof Monz and Josh Schroeder
pdf
ps
bib
Available for download here:
Format of the judgment data:
- Task, e.g. WMT07 Czech-English News Commentary
- Type (NIST or RANK or CONSTITUENT)
- Item ID (sentence number or constituent number)
- Annotator ID (numerical ID since anonymized)
- Time spent on annotation (in seconds)
- System judgments:
- System name, e.g., uedin
- Score, e.g. 2
- Additional score (fluency in NIST, otherwise empty)