A herd of enthusiastic oxen running towards the future

Arxiv Dives

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen 🐂 🧠. We believe diving into the details of research papers is the best way to build fundamental knowledge, spot patterns and keep up with the bleeding edge.

In Arxiv Dives, we cover state of the art research papers, and dive into the gnitty gritty details of how AI models work. From the math to the data to the model architecture, we cover it all.

Arxiv Dives - LLaVA 🌋 an open source Large Multimodal Model (LMM)
Arxiv Dives - LLaVA 🌋 an open source Large Multimodal Model (LMM)

What is LLaVA? LLaVA is a Multi-Modal model that connects a Vision Encoder and an LLM for general purpose visual and language understanding. Paper: https://arxiv.org/abs/2304.084...

Greg Schoeninger
Greg Schoeninger
Jan 7, 2024
12 min read
Arxiv Dives - How Mistral 7B works
Arxiv Dives - How Mistral 7B works

What is Mistral 7B? Mistral 7B is an open weights large language model by Mistral.ai that was build for performance and efficiency. It outshines models that are twice it's size, i...

Greg Schoeninger
Greg Schoeninger
Dec 23, 2023
10 min read
Mamba: Linear-Time Sequence Modeling with Selective State Spaces - Arxiv Dives
Mamba: Linear-Time Sequence Modeling with Selective State Spaces - Arxiv Dives

What is Mamba 🐍? Mamba at it's core is a recurrent neural network architecture, that outperforms Transformers with faster inference and improved handling of long sequences of len...

Greg Schoeninger
Greg Schoeninger
Dec 15, 2023
15 min read
Practical ML Dive - How to customize a Vision Transformer on your own data
Practical ML Dive - How to customize a Vision Transformer on your own data

Welcome to Practical ML Dives, a series spin off of Arxiv Dives. In Arxiv Dives, we cover state of the art research papers, and dive into the gnitty gritty details of how AI model...

Greg Schoeninger
Greg Schoeninger
Dec 14, 2023
20 min read
Arxiv Dives - Zero-shot Image Classification with CLIP
Arxiv Dives - Zero-shot Image Classification with CLIP

CLIP explores the efficacy of learning image representations from scratch with 400 million image-text pairs, showcasing zero-shot transfer capabilities across diverse computer visi...

Greg Schoeninger
Greg Schoeninger
Dec 8, 2023
14 min read
Arxiv Dives - Vision Transformers (ViT)
Arxiv Dives - Vision Transformers (ViT)

With all of the hype around Transformers for natural language processing and text, the authors of this paper beg the question - can we apply self-attention and Transformers to imag...

Greg Schoeninger
Greg Schoeninger
Dec 1, 2023
13 min read
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 2
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 2

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen 🐂 🧠. We believe diving into the details of research papers is the best way to build fund...

Greg Schoeninger
Greg Schoeninger
Nov 21, 2023
16 min read
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 1
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 1

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen 🐂 🧠. We believe diving into the details of research papers is the best way to build fund...

Greg Schoeninger
Greg Schoeninger
Nov 11, 2023
13 min read
Arxiv Dive Manifesto
Arxiv Dive Manifesto

Every Friday the team at Oxen.ai gets together and goes over research papers, blog posts, or books that help us stay up to date with the latest in Machine Learning and AI. We call ...

Greg Schoeninger
Greg Schoeninger
Nov 5, 2023
4 min read
Arxiv Dives - Attention Is All You Need
Arxiv Dives - Attention Is All You Need

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen 🐂 🧠. We believe diving into the details of research papers is the best way to build fund...

Greg Schoeninger
Greg Schoeninger
Nov 4, 2023
17 min read