| Bloom: A 176b-parameter open-access multilingual language model T Le Scao, A Fan, C Akiki, E Pavlick, S Ilić, D Hesslow, R Castagné, ... | 1500 | 2023 |
| Dynabench: Rethinking benchmarking in NLP D Kiela, M Bartolo, Y Nie, D Kaushik, A Geiger, Z Wu, B Vidgen, G Prasad, ... NAACL, 2021 | 363 | 2021 |
| Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality T Thrush*, R Jiang, M Bartolo, A Singh, A Williams, D Kiela, C Ross* CVPR, 2022 | 317 | 2022 |
| Learning from the worst: Dynamically generated datasets to improve online hate detection B Vidgen, T Thrush, Z Waseem, D Kiela ACL, 2021 | 211 | 2021 |
| The BigScience ROOTS Corpus: A 1.6 TB Composite Multilingual Dataset H Laurençon, L Saulnier, T Wang, C Akiki, AV del Moral, T Le Scao, ... NeurIPS Datasets and Benchmarks, 2022 | 151 | 2022 |
| TRL: Transformer reinforcement learning L von Werra, Y Belkada, L Tunstall, E Beeching, T Thrush, N Lambert GitHub. Available online at: https://github.com/lvwerra/trl, 2020 | 139 | 2020 |
| DataPerf: Benchmarks for Data-Centric AI Development M Mazumder, C Banbury, X Yao, B Karlaš, WG Rojas, S Diamos, ... NeurIPS Datasets and Benchmarks, 2024 | 120 | 2024 |
| Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation M Bartolo, T Thrush, R Jia, S Riedel, P Stenetorp, D Kiela EMNLP, 2021 | 85 | 2021 |
| Human-adversarial visual question answering S Sheng, A Singh, V Goswami, JAL Magana, T Thrush, W Galuba, ... NeurIPS, 2021 | 61 | 2021 |
| Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking Z Ma*, K Ethayarajh*, T Thrush*, S Jain, L Wu, R Jia, C Potts, A Williams, ... NeurIPS, 2021 | 58 | 2021 |
| Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hate HR Kirk, B Vidgen, P Röttger, T Thrush, SA Hale NAACL, 2022 | 52 | 2022 |
| Towards language models that can see: Computer vision through the lens of natural language W Berrios, G Mittal, T Thrush, D Kiela, A Singh arXiv preprint arXiv:2306.16410, 2023 | 50 | 2023 |
| Anlizing the adversarial natural language inference dataset A Williams, T Thrush, D Kiela SCiL, 2022 | 41 | 2022 |
| Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistants M Bartolo, T Thrush, S Riedel, P Stenetorp, R Jia, D Kiela NAACL, 2022 | 35 | 2022 |
| Measuring data M Mitchell, AS Luccioni, N Lambert, M Gerchick, A McMillan-Major, ... arXiv preprint arXiv:2212.05129, 2022 | 32 | 2022 |
| Huggingface h4 stack exchange preference dataset N Lambert, L Tunstall, N Rajani, T Thrush https://huggingface.co/datasets/HuggingFaceH4/stack-exchange-preferences, 2023 | 27* | 2023 |
| Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurement L von Werra, L Tunstall, A Thakur, AS Luccioni, T Thrush, A Piktus, ... EMNLP System Demos, 2022 | 23 | 2022 |
| Findings of the WMT 2021 Shared Task on Large-Scale Multilingual Machine Translation G Wenzek, V Chaudhary, A Fan, S Gomez, N Goyal, S Jain, D Kiela, ... WMT at EMNLP, 2021 | 19 | 2021 |
| Investigating Novel Verb Learning in BERT: Selectional Preference Classes and Alternation-Based Syntactic Generalization T Thrush, E Wilcox, R Levy BlackboxNLP at EMNLP, 2020 | 15 | 2020 |
| Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks T Thrush, K Tirumala, A Gupta, M Bartolo, P Rodriguez, T Kane, ... ACL System Demos, 2022 | 12 | 2022 |
Douwe KielaContextual AI, Stanford UniversityVerified email at stanford.edu
