VisualSTS(eng)¶
- Number of tasks: 7
STS12VisualSTS¶
SemEval-2012 Task 6.then rendered into images.
Dataset: mteb/rendered-sts12 • License: not specified • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| image to image (i2i) | cosine_spearman | eng | Encyclopaedic, News, Written | human-annotated | rendered |
Citation
@article{xiao2024pixel,
author = {Xiao, Chenghao and Huang, Zhuoxu and Chen, Danlu and Hudson, G Thomas and Li, Yizhi and Duan, Haoran and Lin, Chenghua and Fu, Jie and Han, Jungong and Moubayed, Noura Al},
journal = {arXiv preprint arXiv:2402.08183},
title = {Pixel Sentence Representation Learning},
year = {2024},
}
STS13VisualSTS¶
SemEval STS 2013 dataset.then rendered into images.
Dataset: mteb/rendered-sts13 • License: not specified • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| image to image (i2i) | cosine_spearman | eng | News, Non-fiction, Web, Written | human-annotated | rendered |
Citation
@article{xiao2024pixel,
author = {Xiao, Chenghao and Huang, Zhuoxu and Chen, Danlu and Hudson, G Thomas and Li, Yizhi and Duan, Haoran and Lin, Chenghua and Fu, Jie and Han, Jungong and Moubayed, Noura Al},
journal = {arXiv preprint arXiv:2402.08183},
title = {Pixel Sentence Representation Learning},
year = {2024},
}
STS14VisualSTS¶
SemEval STS 2014 dataset. Currently only the English dataset.rendered into images.
Dataset: mteb/rendered-sts14 • License: not specified • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| image to image (i2i) | cosine_spearman | eng | Blog, Spoken, Web | derived | rendered |
Citation
@article{xiao2024pixel,
author = {Xiao, Chenghao and Huang, Zhuoxu and Chen, Danlu and Hudson, G Thomas and Li, Yizhi and Duan, Haoran and Lin, Chenghua and Fu, Jie and Han, Jungong and Moubayed, Noura Al},
journal = {arXiv preprint arXiv:2402.08183},
title = {Pixel Sentence Representation Learning},
year = {2024},
}
STS15VisualSTS¶
SemEval STS 2015 datasetrendered into images.
Dataset: mteb/rendered-sts15 • License: not specified • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| image to image (i2i) | cosine_spearman | eng | Blog, News, Spoken, Web, Written | human-annotated | rendered |
Citation
@article{xiao2024pixel,
author = {Xiao, Chenghao and Huang, Zhuoxu and Chen, Danlu and Hudson, G Thomas and Li, Yizhi and Duan, Haoran and Lin, Chenghua and Fu, Jie and Han, Jungong and Moubayed, Noura Al},
journal = {arXiv preprint arXiv:2402.08183},
title = {Pixel Sentence Representation Learning},
year = {2024},
}
STS16VisualSTS¶
SemEval STS 2016 datasetrendered into images.
Dataset: mteb/rendered-sts16 • License: not specified • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| image to image (i2i) | cosine_spearman | eng | Blog, Spoken, Web | human-annotated | rendered |
Citation
@article{xiao2024pixel,
author = {Xiao, Chenghao and Huang, Zhuoxu and Chen, Danlu and Hudson, G Thomas and Li, Yizhi and Duan, Haoran and Lin, Chenghua and Fu, Jie and Han, Jungong and Moubayed, Noura Al},
journal = {arXiv preprint arXiv:2402.08183},
title = {Pixel Sentence Representation Learning},
year = {2024},
}
VisualSTS-b-Eng¶
STSBenchmarkMultilingualVisualSTS English only.
License: not specified • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| image to image (i2i) | cosine_spearman | eng | News, Social, Spoken, Web, Written | human-annotated | rendered |
Citation
@article{xiao2024pixel,
author = {Xiao, Chenghao and Huang, Zhuoxu and Chen, Danlu and Hudson, G Thomas and Li, Yizhi and Duan, Haoran and Lin, Chenghua and Fu, Jie and Han, Jungong and Moubayed, Noura Al},
journal = {arXiv preprint arXiv:2402.08183},
title = {Pixel Sentence Representation Learning},
year = {2024},
}
Tasks
| name | type | modalities | languages |
|---|---|---|---|
| STSBenchmarkMultilingualVisualSTS | VisualSTS(multi) | image | cmn, deu, eng, fra, ita, ... (10) |
VisualSTS17Eng¶
STS17MultilingualVisualSTS English only.
License: not specified • Learn more →
| Task category | Score | Languages | Domains | Annotations Creators | Sample Creation |
|---|---|---|---|---|---|
| image to image (i2i) | cosine_spearman | eng | News, Social, Spoken, Web, Written | human-annotated | rendered |
Citation
@article{xiao2024pixel,
author = {Xiao, Chenghao and Huang, Zhuoxu and Chen, Danlu and Hudson, G Thomas and Li, Yizhi and Duan, Haoran and Lin, Chenghua and Fu, Jie and Han, Jungong and Moubayed, Noura Al},
journal = {arXiv preprint arXiv:2402.08183},
title = {Pixel Sentence Representation Learning},
year = {2024},
}
Tasks
| name | type | modalities | languages |
|---|---|---|---|
| STS17MultilingualVisualSTS | VisualSTS(multi) | image | ara, deu, eng, fra, ita, ... (9) |