LMUnit: Fine-grained Evaluation with Natural Language Unit Tests
Jon Saad-Falcon, Rajan Vivek, William Berrios, Nandita Shankar Naik, Matija Franklin, Bertie Vidgen, Amanpreet Singh, Douwe Kiela, Shikib Mehri
arXiv 2024
OLMoE: Open Mixture-of-Experts Language Models
Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld, Amanpreet Singh, et al.
arXiv 2024
Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
Karel D'Oosterlinck, Winnie Xu, Chris Develder, Thomas Demeester, Amanpreet Singh, Christopher Potts, Douwe Kiela, Shikib Mehri
TACL 2024
Generative Representational Instruction Tuning
Niklas Muennighoff, Hongjin Su, Liang Wang, Nan Yang, Furu Wei, Tao Yu, Amanpreet Singh, Douwe Kiela
arXiv 2024
Towards Language Models That Can See: Computer Vision Through the LENS of Natural Language
William Berrios, Gautam Mittal, Tristan Thrush, Douwe Kiela, Amanpreet Singh
arXiv 2023
OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents
Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Amanpreet Singh, et al.
NeurIPS 2023
Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment
Mingyang Zhou*, Licheng Yu*, Amanpreet Singh, Mengjiao Wang, Zhou Yu, Ning Zhang
CVPR 2022
FLAVA: A Foundational Language And Vision Alignment Model
Amanpreet Singh*, Ronghang Hu*, Vedanuj Goswami*, Guillaume Couairon, Wojciech Galuba, Marcus Rohrbach, Douwe Kiela
CVPR 2022
Human-Adversarial Visual Question Answering
Sasha Sheng*, Amanpreet Singh*, Vedanuj Goswami, Jose Alberto Magna, Tristan Thrush, Wojciech Galuba, Devi Parikh, Douwe Kiela
NeurIPS 2021
Dynabench: Rethinking benchmarking in NLP
Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik, Atticus Geiger, Zhengxuan Wu, Bertie Vidgen, Grusha Prasad, Amanpreet Singh, Pratik Ringshia, Zhiyi Ma, Tristan Thrush, Sebastian Riedel, Zeerak Waseem, Pontus Stenetorp, Robin Jia, Mohit Bansal, Christopher Potts, Adina Williams
NAACL 2021
UniT: Multimodal MultiTask Learning with a Unified Transformer
Ronghang Hu, Amanpreet Singh
ICCV 2021
TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene text
Amanpreet Singh*, Guan Pang*, Mandy Toh*, Jing Huang, Wojciech Galuba, Tal Hassner
CVPR 2021
Seeing the un-scene: Learning amodal semantic maps for room navigation
Medhini Narasimhan, Erik Wijmans, Xinlei Chen, Trevor Darrell, Dhruv Batra, Devi Parikh, Amanpreet Singh
ECCV 2020
TextCaps: A dataset for image captioning with reading comprehension
Oleksii Sidorov, Ronghang Hu, Marcus Rohrbach, Amanpreet Singh
ECCV 2020
Are we pretraining it right? Digging deeper into visio-linguistic pretraining
Amanpreet Singh*, Vedanuj Goswami*, Devi Parikh
arXiv 2020
The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes
Douwe Kiela, Hamed Firooz, Aravind Mohan, Vedanuj Goswami, Amanpreet Singh, Pratik Ringshia, Davide Testuggine
NeurIPS 2020
Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQA
Ronghang Hu, Amanpreet Singh, Trevor Darrell, Marcus Rohrbach
CVPR 2020
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
Alex Wang*, Yada Pruksachatkun*, Nikita Nangia*, Amanpreet Singh*, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman
NeurIPS (Spotlight) 2019
Towards VQA Models That Can Read
Amanpreet Singh, Vivek Natarajan, Meet Shah, Yu Jiang, Xinlei Chen, Dhruv Batra, Devi Parikh, Marcus Rohrbach
CVPR 2019
Learning When to Communicate at Scale in Multiagent Cooperative and Competitive tasks
Amanpreet Singh*, Tushar Jain*, Sainbayar Sukhbaatar
ICLR 2019
Learning Dynamics Model in Reinforcement Learning by Incorporating the Long Term Future
Nan Rosemary Ke, Amanpreet Singh, Ahmed Touati, Anirudh Goyal, Yoshua Bengio, Devi Parikh, Dhruv Batra
ICLR 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman
ICLR 2019
MMF: A multimodal framework for vision & language research
Amanpreet Singh, Vedanuj Goswami, Vivek Natarajan, Yu Jiang, Xinlei Chen, Meet Shah, Marcus Rohrbach, Dhruv Batra, Devi Parikh
SysML Workshop, NeurIPS 2019
Neural Network Acceptability Judgments
Alex Warstadt, Amanpreet Singh, Samuel R. Bowman
TACL, EMNLP (Oral) - 2019 2018
CanvasGAN: A simple baseline for text to image generation by incrementally patching a canvas
Amanpreet Singh, Sharan Agrawal
CVC 2019
