# |
Team |
Task |
Date/Time |
DataID |
RIBES |
Method
|
Other Resources
|
System Description |
juman |
kytea |
mecab |
moses- tokenizer |
stanford- segmenter- ctb |
stanford- segmenter- pku |
indic- tokenizer |
unuse |
myseg |
kmseg |
|
1 | cvit | HINDENen-hi | 2018/09/18 22:37:37 | 2500 | - | - | - | - | - | - | 0.773923 | - | 0.000000 | 0.000000 | NMT | Yes | Averaging Models from epochs 61-68.
Base Transformer.
Uses External Data.
|
2 | cvit | HINDENen-hi | 2018/09/18 21:58:21 | 2496 | - | - | - | - | - | - | 0.773078 | - | 0.000000 | 0.000000 | NMT | Yes | Transformer Base.
Uses External Data.
Averaging of Checkpoints Enabled. |
3 | cvit | HINDENen-hi | 2018/09/18 15:21:13 | 2489 | - | - | - | - | - | - | 0.771549 | - | 0.000000 | 0.000000 | NMT | Yes | Transformer Base. Uses External Data |
4 | WT | HINDENen-hi | 2020/09/03 23:14:36 | 3640 | - | - | - | - | - | - | 0.769138 | - | - | - | NMT | Yes | Multilingual-ensembleX3 |
5 | cvit | HINDENen-hi | 2020/07/06 19:22:29 | 3428 | - | - | - | - | - | - | 0.766753 | - | - | - | NMT | Yes | Multilingual Transformer model.
Uses pib-v0 data. |
6 | cvit | HINDENen-hi | 2019/05/27 16:03:36 | 2680 | - | - | - | - | - | - | 0.765422 | - | 0.000000 | 0.000000 | NMT | Yes | massive-multi + bt |
7 | WT | HINDENen-hi | 2020/09/03 18:20:14 | 3639 | - | - | - | - | - | - | 0.765340 | - | - | - | NMT | No | Used 5M Back translation news crawl data to train. Method: Transformer NMT; Preprocessing: 1. Removed mixed language sentences 2. moses tokeniser for English and for Hindi indicnlp normaliser and toke |
8 | cvit | HINDENen-hi | 2020/07/10 04:40:19 | 3436 | - | - | - | - | - | - | 0.764496 | - | - | - | NMT | Yes | Multilingual model, uses pib-v2 data |
9 | NICT-5 | HINDENen-hi | 2020/09/18 17:47:18 | 3935 | - | - | - | - | - | - | 0.763000 | - | - | - | NMT | No | MBART Fine Tune on approx. 900k sentence pairs from whole HindEn dataset. |
10 | CUNI | HINDENen-hi | 2018/09/15 01:22:03 | 2365 | - | - | - | - | - | - | 0.761582 | - | 0.000000 | 0.000000 | NMT | No | Transformer big, transfer learning from EN-CS 1M steps, only backtranslation EN-HI, no original EN-HI, beam=8; alpha=0.8; averaging of last 8 models after 700k steps |
11 | CUNI | HINDENen-hi | 2018/09/15 01:12:40 | 2361 | - | - | - | - | - | - | 0.761292 | - | 0.000000 | 0.000000 | NMT | No | Transformer big, only backtranslation EN-HI, no original EN-HI, beam=8; alpha=0.8; averaging of last 8 models after 1300k steps |
12 | cvit | HINDENen-hi | 2019/03/15 01:21:27 | 2642 | - | - | - | - | - | - | 0.761061 | - | 0.000000 | 0.000000 | NMT | Yes | massive-multi |
13 | cvit | HINDENen-hi | 2020/07/06 19:08:49 | 3427 | - | - | - | - | - | - | 0.758405 | - | - | - | NMT | Yes | Multilingual Transformer model. |
14 | cvit | HINDENen-hi | 2018/09/09 21:12:29 | 2254 | - | - | - | - | - | - | 0.758365 | - | 0.000000 | 0.000000 | NMT | Yes | ConvS2S.
Uses external data. |
15 | CUNI | HINDENen-hi | 2018/09/15 01:19:04 | 2363 | - | - | - | - | - | - | 0.754966 | - | 0.000000 | 0.000000 | NMT | No | Transformer big, transfer learning from EN-CS 1M steps, only original EN-HI, beam=8; alpha=0.8; averaging of last 8 models after 230k steps. |
16 | CUNI | HINDENen-hi | 2018/09/13 22:18:14 | 2320 | - | - | - | - | - | - | 0.754244 | - | 0.000000 | 0.000000 | NMT | No | Big Transformer model with backtranslation, with transfer learning from English to Czech. |
17 | CUNI | HINDENen-hi | 2018/09/15 01:14:34 | 2362 | - | - | - | - | - | - | 0.753895 | - | 0.000000 | 0.000000 | NMT | No | Transformer big, transfer learning from EN-CS 1M steps, followed by only backtranslation EN-HI for 300k steps, followed by original EN-HI for 500k steps, beam=8; alpha=0.8; averaging of last 8 models. |
18 | XMUNLP | HINDENen-hi | 2017/07/28 23:38:29 | 1576 | - | - | - | - | - | - | 0.749660 | 0.000000 | 0.000000 | 0.000000 | NMT | No | ensemble of 4 nmt models + monolingual data |
19 | cvit | HINDENen-hi | 2018/09/07 12:29:04 | 2235 | - | - | - | - | - | - | 0.748008 | - | 0.000000 | 0.000000 | NMT | Yes | ConvS2S Model. External Data is used. |
20 | XMUNLP | HINDENen-hi | 2017/07/27 22:04:54 | 1508 | - | - | - | - | - | - | 0.743129 | 0.000000 | 0.000000 | 0.000000 | NMT | No | single nmt model + monolingual data |
21 | CUNI | HINDENen-hi | 2018/09/15 01:20:33 | 2364 | - | - | - | - | - | - | 0.733738 | - | 0.000000 | 0.000000 | NMT | No | Baseline, transformer big only EN-HI, beam=8, alpha=0.8, averaging 8 steps after 330k steps |
22 | cvit | HINDENen-hi | 2019/03/15 01:31:41 | 2644 | - | - | - | - | - | - | 0.718374 | - | 0.000000 | 0.000000 | NMT | Yes | massive-multi + ft |
23 | ORGANIZER | HINDENen-hi | 2016/07/26 10:07:48 | 1032 | - | - | - | - | - | - | 0.716788 | 0.000000 | 0.000000 | 0.000000 | Other | Yes | Online A (2016) |
24 | cvit | HINDENen-hi | 2018/09/09 01:20:09 | 2251 | - | - | - | - | - | - | 0.714197 | - | 0.000000 | 0.000000 | NMT | No | ConvS2S Model.
IIT-Bombay data filtered with langdetect.
+ Backtranslated Monolingual Data ppl in [0.05, 0.14]
|
25 | XMUNLP | HINDENen-hi | 2017/07/20 23:07:38 | 1422 | - | - | - | - | - | - | 0.712876 | 0.000000 | 0.000000 | 0.000000 | NMT | No | single nmt model |
26 | ORGANIZER | HINDENen-hi | 2018/11/13 14:54:58 | 2566 | - | - | - | - | - | - | 0.710210 | - | 0.000000 | 0.000000 | NMT | No | NMT with Attention |
27 | ORGANIZER | HINDENen-hi | 2016/07/26 13:24:22 | 1047 | - | - | - | - | - | - | 0.691298 | 0.000000 | 0.000000 | 0.000000 | Other | Yes | Online B (2016) |
28 | IITP-MT | HINDENen-hi | 2016/08/18 23:13:25 | 1185 | - | - | - | - | - | - | 0.688913 | 0.000000 | 0.000000 | 0.000000 | SMT | Yes | IITP-MT System1 |
29 | IITB-MTG | HINDENen-hi | 2017/08/01 15:09:01 | 1725 | - | - | - | - | - | - | 0.688606 | 0.000000 | 0.000000 | 0.000000 | NMT | No | NMT with ensemble (last 3 + best validation) |
30 | IITP-MT | HINDENen-hi | 2016/08/29 18:51:44 | 1290 | - | - | - | - | - | - | 0.683022 | 0.000000 | 0.000000 | 0.000000 | SMT | No | IITP-MT System2 |
31 | EHR | HINDENen-hi | 2016/08/17 14:30:08 | 1166 | - | - | - | - | - | - | 0.671866 | 0.000000 | 0.000000 | 0.000000 | SMT | No | PBSMT with preordering (DL=6) |
32 | ORGANIZER | HINDENen-hi | 2016/08/20 17:41:36 | 1252 | - | - | - | - | - | - | 0.651166 | 0.000000 | 0.000000 | 0.000000 | SMT | No | Phrase-based SMT |
33 | IITB-MTG | HINDENen-hi | 2017/09/05 23:04:58 | 1763 | - | - | - | - | - | - | 0.301241 | 0.000000 | 0.000000 | 0.000000 | NMT | No | |