Skip to content
Free planNo credit card requiredStart writing
AI for Research home
AI for Research home
Dashboard
Sign inGet started

article · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · 2022

FLAVA: A Foundational Language And Vision Alignment Model

Amanpreet Singh, Ronghang Hu, Vedanuj Goswami, Guillaume Couairon, Wojciech Galuba, Marcus Rohrbach, Douwe Kiela

Cited by 459Abstract and details only

Abstract

State-of-the-art vision and vision-and-language models rely on large-scale visio-linguistic pretraining for obtaining good performance on a variety of downstream tasks. Generally, such models are often either cross-modal (contrastive) or multi-modal (with earlier fusion) but not both; and they often only target specific modalities or tasks. A promising direction would be to use a single holistic universal model, as a “foundation”, that targets all modalities at once-a true vision and language foundation model should be good at vision tasks, language tasks, and cross- and multi-modal vision and language tasks. We introduce FLAVA as such a model and demonstrate impressive performance on a wide range of 35 tasks spanning these target modalities.

Cite this paper

APA 7

Singh, A., Hu, R., Goswami, V., Couairon, G., Galuba, W., Rohrbach, M., & Kiela, D. (2022). FLAVA: A Foundational Language And Vision Alignment Model. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 15617–15629. https://doi.org/10.1109/cvpr52688.2022.01519

MLA 9

Singh, Amanpreet, et al. “FLAVA: A Foundational Language And Vision Alignment Model.” 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 15617–29, https://doi.org/10.1109/cvpr52688.2022.01519.

Chicago

Singh, Amanpreet, Ronghang Hu, Vedanuj Goswami, Guillaume Couairon, Wojciech Galuba, Marcus Rohrbach, and Douwe Kiela. 2022. “FLAVA: A Foundational Language And Vision Alignment Model.” 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR): 15617–29. https://doi.org/10.1109/cvpr52688.2022.01519.

Harvard

Singh, A. et al. (2022) ‘FLAVA: A Foundational Language And Vision Alignment Model’, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 15617–15629. Available at: https://doi.org/10.1109/cvpr52688.2022.01519.

BibTeX
@article{singh2022flava,
  title = {{FLAVA: A Foundational Language And Vision Alignment Model}},
  author = {Singh, Amanpreet and Hu, Ronghang and Goswami, Vedanuj and Couairon, Guillaume and Galuba, Wojciech and Rohrbach, Marcus and Kiela, Douwe},
  journal = {2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  pages = {15617--15629},
  year = {2022},
  doi = {10.1109/cvpr52688.2022.01519}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.

Related papers