Summarization¶
- Number of tasks: 4
SummEval¶
News Article Summary Semantic Similarity Estimation.
Dataset: mteb/summeval • License: mit • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| text to text (t2t) | cosine_spearman | eng | News, Written | human-annotated | created |
Citation
@article{fabbri2020summeval,
author = {Fabbri, Alexander R and Kry{\'s}ci{\'n}ski, Wojciech and McCann, Bryan and Xiong, Caiming and Socher, Richard and Radev, Dragomir},
journal = {arXiv preprint arXiv:2007.12626},
title = {SummEval: Re-evaluating Summarization Evaluation},
year = {2020},
}
SummEvalFr¶
News Article Summary Semantic Similarity Estimation translated from english to french with DeepL.
Dataset: lyon-nlp/summarization-summeval-fr-p2p • License: mit • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| text to text (t2t) | cosine_spearman | fra | News, Written | human-annotated | machine-translated |
Citation
@article{fabbri2020summeval,
author = {Fabbri, Alexander R and Kry{\'s}ci{\'n}ski, Wojciech and McCann, Bryan and Xiong, Caiming and Socher, Richard and Radev, Dragomir},
journal = {arXiv preprint arXiv:2007.12626},
title = {SummEval: Re-evaluating Summarization Evaluation},
year = {2020},
}
SummEvalFrSummarization.v2¶
News Article Summary Semantic Similarity Estimation translated from english to french with DeepL. This version fixes a bug in the evaluation script that caused the main score to be computed incorrectly.
Dataset: lyon-nlp/summarization-summeval-fr-p2p • License: mit • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| text to text (t2t) | cosine_spearman | fra | News, Written | human-annotated | machine-translated |
Citation
@article{fabbri2020summeval,
author = {Fabbri, Alexander R and Kry{\'s}ci{\'n}ski, Wojciech and McCann, Bryan and Xiong, Caiming and Socher, Richard and Radev, Dragomir},
journal = {arXiv preprint arXiv:2007.12626},
title = {SummEval: Re-evaluating Summarization Evaluation},
year = {2020},
}
SummEvalSummarization.v2¶
News Article Summary Semantic Similarity Estimation. This version fixes a bug in the evaluation script that caused the main score to be computed incorrectly.
Dataset: mteb/summeval • License: mit • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| text to text (t2t) | cosine_spearman | eng | News, Written | human-annotated | created |
Citation
@article{fabbri2020summeval,
author = {Fabbri, Alexander R and Kry{\'s}ci{\'n}ski, Wojciech and McCann, Bryan and Xiong, Caiming and Socher, Richard and Radev, Dragomir},
journal = {arXiv preprint arXiv:2007.12626},
title = {SummEval: Re-evaluating Summarization Evaluation},
year = {2020},
}