Evaluating Large Multimodal Models for Integrated Capabilities

A Dataset for VQA on Document Images.

AI2 Diagrams (AI2D) is a dataset of over 5000 grade school science diagrams with over 150000 rich annotations, their ground truth syntactic parses, and more than 15000 corresponding multiple choice questions.

A Benchmark for Visual Question Answering using World Knowledge.

This dataset contains Nike product names and descriptions that we are translating to other languages to test models ability for machine translation.

A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI

Caldera data set from Call of Duty®: Warzone™

ImageNet is an image database organized according to the WordNet hierarchy (currently only the nouns), in which each node of the hierarchy is depicted by hundreds and thousands of images. The project has been instrumental in advancing computer vision and deep learning research.

CelebFaces Attributes Dataset (CelebA) is a large-scale face attributes dataset with more than 200K celebrity images, each with 40 attribute annotations. The images in this dataset cover large pose variations and background clutter. CelebA has large diversities, large quantities, and rich annotations.