Run Models On Your Data
Oxen makes it easy to choose the right model, get to the perfect prompt, or kick off the data flywheel that is needed to improve state of the art AI.
Trusted by a community of engineers and researchers at companies like
Public Datasets
Explore Datasets
Oxen’s public and private datasets allow you to iterate on data within your organization or share them with the world.
datasets/ARC-Challenge
A dataset from the Allen Institute of AI consisting of genuine grade-school level, multiple-choice science questions, assembled to encourage research in advanced question-answering. The dataset the Challenging Set of questions.
1 text files > 99%
121
ox/Flickr8k
A benchmark collection for sentence-based image description and search, consisting of 8,000 images that are each paired with five different captions which provide clear descriptions of the salient entities and events. … The images were chosen from six different Flickr groups, and tend not to contain any well-known people or locations, but were manually selected to depict a variety of scenes and situations.
8.1K image files > 99%
9 text files < 1%
3 tabular files < 1%
30
ox/MiniSpeechCommands
Subset of speech commands to test audio recognition systems on.
8K audio files > 99%
3 text files < 1%
1 tabular files < 1%
10
datasets/CelebA
CelebFaces Attributes Dataset (CelebA) is a large-scale face attributes dataset with more than 200K celebrity images, each with 40 attribute annotations. The images in this dataset cover large pose variations and background clutter. CelebA has large diversities, large quantities, and rich annotations.
203K image files > 99%
6 text files < 1%
4 tabular files < 1%
115
Measure PerformanceBetter Datasets.
Better Datasets.
Better AI.
AI is only as good as the datasets you feed it. Gain visibility into the data that goes in and out of your model.
Version Control
Find the changes that matter
Datasets change every day. Oxen’s version control allows you to quickly narrow down the most important changes that affect your model.
Scalability & VersatilityThousands of hours of audio?
Thousands of hours of audio?
Millions of images?
Billion rows in your csv?
No problem.
Oxen’s data version control is built to handle data of any shape or size.
Performance
Built for speed
Oxen.ai saves your engineers hours syncing data from training, testing, to evaluation. From fast syncing of data to removing push/pull bottlenecks from traditional VCS systems, Oxen.ai was built for machine learning datasets and workflows.
Data VisibilityGoodbye Messy Blob Storage.
Goodbye Messy Blob Storage.
Hello Oxen.
Oxen’s data version control turns your unstructured data into beautifully rendered datasets that evolve over time. Dive into any version of the dataset at any point in time and see exactly what changed.
Command Line Tooling
Powered by industrial strength version control
Oxen.ai has re-imagined version control for data. At the core are the same principles that have made Git so powerful, but Oxen has optimized down to the merkle trees, hashing principles, and network protocols to make it work effortlessly with large scale datasets.
Collaboration
Collaborate with your team
Oxen.ai allows all your stakeholders to share, review, and edit data together. ML Engineering, Data Science, Product, Legal, Auditing, and Community can all contribute. The more eyes the better.
Features that matter to you and your team
| Ease of Use | Performance | Collaboration | Open Source | Data Visibility | Scalability | Any Data Format | Compare & Diff | |
|---|---|---|---|---|---|---|---|---|
| Hugging Face | * | ** | ||||||
| Neptune.ai | ||||||||
| LakeFS | ||||||||
| DVC | ||||||||
| GitLFS | ||||||||
| Project Nessie |
| * | Hugging Face is migrating their data versioning from Git LFS to the closed source Xethub. As Hugging Face is not open source, it is expected that Xethub will remain closed-source |
| ** | While small datasets have a preview and are visible in Hugging Face, large datasets are unable to be seen through their website |
Community
Join the growing Herd
Oxen.ai has developed a strong and growing community of individuals focused on furthering machine learning and artificial intelligence. From academic researchers training the next generation of models, to full-stack developers leveraging existing API's to build amazing products. Every Friday we get together and read research papers, discuss them, and apply them to our own work.
