Oxen.ai Blog

Welcome to the Oxen.ai blog 🐂

The team at Oxen.ai is dedicated to helping AI practictioners go from research to production. To help enable this, we host a research paper club on Fridays called ArXiv Dives, where we go over state of the art research and how you can apply it to your own work.

Take a look at our Arxiv Dives, Practical ML Dives as well as a treasure trove of content on how to go from raw datasets to production ready AI/ML systems. We cover everything from prompt engineering, fine-tuning, computer vision, natural language understanding, generative ai, data engineering, to best practices when versioning your data. So, dive in and explore – we're excited to share our journey and learnings with you 🚀

Arxiv Dives - Vision Transformers (ViT)
Arxiv Dives - Vision Transformers (ViT)

With all of the hype around Transformers for natural language processing and text, the authors of this paper beg the question - can we apply self-attention and Transformers to imag...

Greg Schoeninger
Greg Schoeninger
Dec 1, 2023
- Arxiv Dives
13 min read
Reading List For Andrej Karpathy’s “Intro to Large Language Models” Video
Reading List For Andrej Karpathy’s “Intro to Large Language Models” Video

Andrej Karpathy recently released an hour long talk on “The busy person’s intro to large language models” that had some great tidbits whether you are an expert in machine learning ...

Greg Schoeninger
Greg Schoeninger
Nov 27, 2023
11 min read
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 2
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 2

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen 🐂 🧠. We believe diving into the details of research papers is the best way to build fund...

Greg Schoeninger
Greg Schoeninger
Nov 21, 2023
- Arxiv Dives
16 min read
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 1
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 1

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen 🐂 🧠. We believe diving into the details of research papers is the best way to build fund...

Greg Schoeninger
Greg Schoeninger
Nov 11, 2023
- Arxiv Dives
13 min read
Data Version Control 101 with Oxen
Data Version Control 101 with Oxen

This intro tutorial from Oxen.ai shows how Oxen can make versioning your data as easy as versioning your code. Oxen is built to track and store changes for everything from a singl...

Greg Schoeninger
Greg Schoeninger
Nov 9, 2023
12 min read
Arxiv Dive Manifesto
Arxiv Dive Manifesto

Every Friday the team at Oxen.ai gets together and goes over research papers, blog posts, or books that help us stay up to date with the latest in Machine Learning and AI. We call ...

Greg Schoeninger
Greg Schoeninger
Nov 5, 2023
- Arxiv Dives
4 min read
Arxiv Dives - Attention Is All You Need
Arxiv Dives - Attention Is All You Need

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen 🐂 🧠. We believe diving into the details of research papers is the best way to build fund...

Greg Schoeninger
Greg Schoeninger
Nov 4, 2023
- Arxiv Dives
17 min read
Arxiv Dives - How LoRA fine-tuning works
Arxiv Dives - How LoRA fine-tuning works

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen 🐂 🧠. We believe diving into the details of research papers is the best way to build fund...

Greg Schoeninger
Greg Schoeninger
Oct 27, 2023
- Arxiv Dives
10 min read
How to run Llama-2 on CPU after fine-tuning with LoRA
How to run Llama-2 on CPU after fine-tuning with LoRA

Running Large Language Models (LLMs) on the edge is a fascinating area of research, and opens up many use cases that require data privacy or lower cost profiles. With libraries lik...

Greg Schoeninger
Greg Schoeninger
Oct 23, 2023
10 min read
Arxiv Dives - Generating Speech from Text with Fast Speech-2
Arxiv Dives - Generating Speech from Text with Fast Speech-2

Every Friday at Oxen.ai we host a public paper club called "Arxiv Dives" to make us smarter Oxen 🐂 🧠. We believe diving into the details of research papers is the best way to bui...

Greg Schoeninger
Greg Schoeninger
Oct 21, 2023
- Arxiv Dives
11 min read