# |
Team |
Task |
Date/Time |
DataID |
AMFM |
Method
|
Other Resources
|
System Description |
unuse |
unuse |
unuse |
unuse |
unuse |
unuse |
unuse |
unuse |
unuse |
unuse |
|
1 | cvit | HINDENen-hi | 2020/07/06 19:08:49 | 3427 | - | - | - | - | - | - | 0.867360 | - | - | - | NMT | Yes | Multilingual Transformer model. |
2 | cvit | HINDENen-hi | 2020/07/06 19:22:29 | 3428 | - | - | - | - | - | - | 0.866410 | - | - | - | NMT | Yes | Multilingual Transformer model.
Uses pib-v0 data. |
3 | cvit | HINDENen-hi | 2020/07/10 04:40:19 | 3436 | - | - | - | - | - | - | 0.868770 | - | - | - | NMT | Yes | Multilingual model, uses pib-v2 data |
4 | WT | HINDENen-hi | 2020/09/03 18:20:14 | 3639 | - | - | - | - | - | - | 0.869400 | - | - | - | NMT | No | Used 5M Back translation news crawl data to train. Method: Transformer NMT; Preprocessing: 1. Removed mixed language sentences 2. moses tokeniser for English and for Hindi indicnlp normaliser and toke |
5 | WT | HINDENen-hi | 2020/09/03 23:14:36 | 3640 | - | - | - | - | - | - | 0.873830 | - | - | - | NMT | Yes | Multilingual-ensembleX3 |
6 | NICT-5 | HINDENen-hi | 2020/09/18 17:47:18 | 3935 | - | - | - | - | - | - | 0.864600 | - | - | - | NMT | No | MBART Fine Tune on approx. 900k sentence pairs from whole HindEn dataset. |
7 | NICT-5 | HINDENen-hi | 2021/03/17 22:51:47 | 4557 | - | - | - | - | - | - | 0.861390 | - | - | - | NMT | No | EnHi nmt model trained using my own toolkit. Only the parallel corpus is used. No fine tuning no pretraining. beam 4 lp 1.0. |
8 | NICT-5 | HINDENen-hi | 2021/03/18 23:06:49 | 4571 | - | - | - | - | - | - | 0.861970 | - | - | - | NMT | Yes | FT on an mBART model. Beam size 8. |
9 | ORGANIZER | HINDENen-hi | 2016/07/26 10:07:48 | 1032 | - | - | - | - | - | - | 0.670660 | 0.000000 | 0.000000 | 0.000000 | Other | Yes | Online A (2016) |
10 | ORGANIZER | HINDENen-hi | 2016/07/26 13:24:22 | 1047 | - | - | - | - | - | - | 0.668450 | 0.000000 | 0.000000 | 0.000000 | Other | Yes | Online B (2016) |
11 | EHR | HINDENen-hi | 2016/08/17 14:30:08 | 1166 | - | - | - | - | - | - | 0.650750 | 0.000000 | 0.000000 | 0.000000 | SMT | No | PBSMT with preordering (DL=6) |
12 | IITP-MT | HINDENen-hi | 2016/08/18 23:13:25 | 1185 | - | - | - | - | - | - | 0.657330 | 0.000000 | 0.000000 | 0.000000 | SMT | Yes | IITP-MT System1 |
13 | ORGANIZER | HINDENen-hi | 2016/08/20 17:41:36 | 1252 | - | - | - | - | - | - | 0.660860 | 0.000000 | 0.000000 | 0.000000 | SMT | No | Phrase-based SMT |
14 | IITP-MT | HINDENen-hi | 2016/08/29 18:51:44 | 1290 | - | - | - | - | - | - | 0.663210 | 0.000000 | 0.000000 | 0.000000 | SMT | No | IITP-MT System2 |
15 | XMUNLP | HINDENen-hi | 2017/07/20 23:07:38 | 1422 | - | - | - | - | - | - | 0.647740 | 0.000000 | 0.000000 | 0.000000 | NMT | No | single nmt model |
16 | XMUNLP | HINDENen-hi | 2017/07/27 22:04:54 | 1508 | - | - | - | - | - | - | 0.682500 | 0.000000 | 0.000000 | 0.000000 | NMT | No | single nmt model + monolingual data |
17 | XMUNLP | HINDENen-hi | 2017/07/28 23:38:29 | 1576 | - | - | - | - | - | - | 0.688770 | 0.000000 | 0.000000 | 0.000000 | NMT | No | ensemble of 4 nmt models + monolingual data |
18 | IITB-MTG | HINDENen-hi | 2017/08/01 15:09:01 | 1725 | - | - | - | - | - | - | 0.624780 | 0.000000 | 0.000000 | 0.000000 | NMT | No | NMT with ensemble (last 3 + best validation) |
19 | IITB-MTG | HINDENen-hi | 2017/09/05 23:04:58 | 1763 | - | - | - | - | - | - | 0.463350 | 0.000000 | 0.000000 | 0.000000 | NMT | No | |
20 | cvit | HINDENen-hi | 2018/09/07 12:29:04 | 2235 | - | - | - | - | - | - | 0.697630 | - | 0.000000 | 0.000000 | NMT | Yes | ConvS2S Model. External Data is used. |
21 | cvit | HINDENen-hi | 2018/09/09 01:20:09 | 2251 | - | - | - | - | - | - | 0.664330 | - | 0.000000 | 0.000000 | NMT | No | ConvS2S Model.
IIT-Bombay data filtered with langdetect.
+ Backtranslated Monolingual Data ppl in [0.05, 0.14]
|
22 | cvit | HINDENen-hi | 2018/09/09 21:12:29 | 2254 | - | - | - | - | - | - | 0.699810 | - | 0.000000 | 0.000000 | NMT | Yes | ConvS2S.
Uses external data. |
23 | CUNI | HINDENen-hi | 2018/09/13 22:18:14 | 2320 | - | - | - | - | - | - | 0.700240 | - | 0.000000 | 0.000000 | NMT | No | Big Transformer model with backtranslation, with transfer learning from English to Czech. |
24 | CUNI | HINDENen-hi | 2018/09/15 01:12:40 | 2361 | - | - | - | - | - | - | 0.704220 | - | 0.000000 | 0.000000 | NMT | No | Transformer big, only backtranslation EN-HI, no original EN-HI, beam=8; alpha=0.8; averaging of last 8 models after 1300k steps |
25 | CUNI | HINDENen-hi | 2018/09/15 01:14:34 | 2362 | - | - | - | - | - | - | 0.693830 | - | 0.000000 | 0.000000 | NMT | No | Transformer big, transfer learning from EN-CS 1M steps, followed by only backtranslation EN-HI for 300k steps, followed by original EN-HI for 500k steps, beam=8; alpha=0.8; averaging of last 8 models. |
26 | CUNI | HINDENen-hi | 2018/09/15 01:19:04 | 2363 | - | - | - | - | - | - | 0.690150 | - | 0.000000 | 0.000000 | NMT | No | Transformer big, transfer learning from EN-CS 1M steps, only original EN-HI, beam=8; alpha=0.8; averaging of last 8 models after 230k steps. |
27 | CUNI | HINDENen-hi | 2018/09/15 01:20:33 | 2364 | - | - | - | - | - | - | 0.681460 | - | 0.000000 | 0.000000 | NMT | No | Baseline, transformer big only EN-HI, beam=8, alpha=0.8, averaging 8 steps after 330k steps |
28 | CUNI | HINDENen-hi | 2018/09/15 01:22:03 | 2365 | - | - | - | - | - | - | 0.701300 | - | 0.000000 | 0.000000 | NMT | No | Transformer big, transfer learning from EN-CS 1M steps, only backtranslation EN-HI, no original EN-HI, beam=8; alpha=0.8; averaging of last 8 models after 700k steps |
29 | cvit | HINDENen-hi | 2018/09/18 15:21:13 | 2489 | - | - | - | - | - | - | 0.712200 | - | 0.000000 | 0.000000 | NMT | Yes | Transformer Base. Uses External Data |
30 | cvit | HINDENen-hi | 2018/09/18 21:58:21 | 2496 | - | - | - | - | - | - | 0.712010 | - | 0.000000 | 0.000000 | NMT | Yes | Transformer Base.
Uses External Data.
Averaging of Checkpoints Enabled. |
31 | cvit | HINDENen-hi | 2018/09/18 22:37:37 | 2500 | - | - | - | - | - | - | 0.712110 | - | 0.000000 | 0.000000 | NMT | Yes | Averaging Models from epochs 61-68.
Base Transformer.
Uses External Data.
|
32 | ORGANIZER | HINDENen-hi | 2018/11/13 14:54:58 | 2566 | - | - | - | - | - | - | 0.644860 | - | 0.000000 | 0.000000 | NMT | No | NMT with Attention |
33 | cvit | HINDENen-hi | 2019/03/15 01:21:27 | 2642 | - | - | - | - | - | - | 0.701670 | - | 0.000000 | 0.000000 | NMT | Yes | massive-multi |
34 | cvit | HINDENen-hi | 2019/03/15 01:31:41 | 2644 | - | - | - | - | - | - | 0.680620 | - | 0.000000 | 0.000000 | NMT | Yes | massive-multi + ft |
35 | cvit | HINDENen-hi | 2019/05/27 16:03:36 | 2680 | - | - | - | - | - | - | 0.702380 | - | 0.000000 | 0.000000 | NMT | Yes | massive-multi + bt |