Models | BLEU | chrF2 | TER | ROUGE-1 | ROUGE-2 | ROUGE-L |
---|---|---|---|---|---|---|
Human | 45.6 | 44.2 | 34.4 | 77.4 | 50.7 | 76.2 |
GuwenBERT-base | 40.1 | 38.1 | 37.5 | 72.5 | 46.0 | 70.3 |
GuwenBERT-large | 38.8 | 37.2 | 38.1 | 70.1 | 43.7 | 67.7 |
GuwenBERT-base-fs | 36.3 | 35.2 | 39.2 | 68.3 | 41.2 | 65.7 |
RoBERTa-CCBC | 39.1 | 37.1 | 36.8 | 71.4 | 44.9 | 69.3 |
RoBERTa-CCLC | 39.8 | 38.0 | 36.4 | 71.6 | 45.3 | 69.3 |
SikuBERT | 38.8 | 36.2 | 37.9 | 72.0 | 45.5 | 69.8 |
SikuRoBERTa | 39.1 | 36.5 | 37.7 | 72.2 | 45.7 | 70.0 |
RoBERTa-wwm-ext | 38.0 | 35.8 | 39.1 | 69.9 | 43.2 | 66.7 |
DeBERTa-base | 39.5 | 37.8 | 35.9 | 71.9 | 44.2 | 68.7 |