JST_LOGO.JPG NICT_LOGO.JPG KYOTO-U_LOGO.JPG

WAT

The Workshop on Asian Translation
Automatic Evaluation Procedures
for Myanmar Translation Results

[AUTOMATIC EVALUATION PROCEDURES TOP] | [SETUP] | [SEGMENTATION] | [EVALUATION]

Setup

Here, ${TLANG} representes the target language, and "my" can be applied.
We assume that there are a reference file (test.alt.${TLANG}) in tests.org/, a translation result file (test.alt.${TLANG}) in results.org/ and all tools in ${path}.
TLANG=my
SCRIPT=${path}/wat2019.my-en
MOSES_SCRIPT=${path}/mosesdecoder-RELEASE-2.1.1/scripts
RIBES=${path}/RIBES-1.02.4
mkdir tests.tok
mkdir results.tok
Back to top

Segmentation

  • Segmenter

    • for file in tests results; do
      cat ${file}.org/test.alt.${TLANG} | \
       python ${SCRIPT}/myseg.py | \
       > ${file}.tok/test.alt.${TLANG}
    done

    Back to top

    Evaluation

  • BLEU

    • perl ${MOSES_SCRIPT}/generic/multi-bleu.perl tests.tok/test.alt.${TLANG} < results.tok/test.alt.${TLANG}

  • RIBES

    • python3 ${RIBES}/RIBES.py -c -r tests.tok/test.alt.${TLANG} results.tok/test.alt.${TLANG}

    Back to top

    JST (Japan Science and Technology Agency)
    NICT (National Institute of Information and Communications Technology)
    Kyoto University
    Last Modified: 2019-07-26