datasets
datasets's Repositories
alpaca
PublicThis is a cleaned version of the original Alpaca Dataset released by Stanford.
ultrafeedback
PublicThis is a cleaned version of the HuggingFaceH4/ultrafeedback_binarized dataset that just has the chosen and rejected samples.
Not-In-Context
PublicQuestion, context, answer triples that are marked as having the answer in context, not having the answer in context, and being a question that does not make sense to ask.
ThePasture
PublicA growing and diverse dataset of text for AI to graze on and learn new information. Just like a pasture in the wild, it is a combination of sources. All the data is in Arrow format so it is easy to randomly access and stream.
LLaVA-Instruct
PublicLLaVA Visual Instruct 150K is a set of GPT-generated multimodal instruction-following data. It is constructed for visual instruction tuning and for building large multimodal towards GPT-4 vision/language capability.
Wikipedia
PublicWikipedia dataset containing cleaned articles. There are 6.4 million articles that can be streamed via apache arrow files.
WikiText
PublicThe WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia. The dataset is available under the Creative Commons Attribution-ShareAlike License.
NQ-Open
PublicThe NQ-Open task, introduced by Lee et.al. 2019, is an open domain question answering benchmark that is derived from Natural Questions. The goal is to predict an English answer string for an input English question. All questions can be answered using the contents of English Wikipedia.