Evaluations
Run models against your data
Introducing Evaluations, a powerful feature designed to enable you to effortlessly test and compare a selection of AI models against your datasets.
Whether you're fine-tuning models or evaluating performance metrics, Oxen evaluations simplifies the process, allowing you to quickly and easily run prompts through an entire dataset.
Once you're happy with the results, output the resulting dataset to a new file, another branch, or directly as a new commit.
381a59b1-f580-4c86-bcbc-761868afa3ce
OpenAIOpenAI/GPT 4o minitext → text
Mathias Barragan
mathias
5 months ago
You are an expert at evaluating similarities between product descriptions. You will be given two descriptions, rate them between 1-5. If they are similar rate them a 5, if dissimilar a 1.
Evaluate how similar these two descriptions are:

Description 1:
{description}

Description 2:
{french_to_english}

Only respond with the number, nothing else, no matter what.
completed 112 rows36794 tokens$ 0.0056 3 iterations
f258abd0-5a30-473d-9d37-c2807e58076a
OpenAIOpenAI/GPT 4o minitext → text
Mathias Barragan
mathias
5 months ago
You are an expert at evaluating similarities between product descriptions. You will be given two descriptions, rate them between 1-5. If they are similar rate them a 5, if dissimilar a 1.
Evaluate how similar these two descriptions are:

Description 1:
{description}

Description 2:
{french_to_english}

Only respond with the number, nothing else, no matter what.
french-mixtral-8x7b
completed 5 row sample2047 tokens$ 0.0003 2 iterations
ee1f7b0b-b6b0-4451-839b-0ebcebae077b
Mistral AIMistral AI/Mixtral 8x7Btext → text
Mathias Barragan
mathias
5 months ago
You are an expert in translating from French to English. Only respond with the translated text nothing else.

Translate the following text to English:

{english_to_french}
french-mixtral-8x7b
french-mixtral-8x7b
completed 112 rows48960 tokens$ 0.0343 2 iterations
981e6579-76e4-4031-b434-dd325506a1d0
OpenAIOpenAI/Text Embedding 3 - Smalltext → embeddings
Bessie
ox
7 months ago
name
completed 112 rows769 tokens$ 0.0000 1 iteration
51fe4337-f632-47d9-8c10-e6e83ec5e483
Mistral AIMistral AI/Mixtral 8x7Btext → text
Bessie
ox
7 months ago
You are an expert in translating from English to French. Only respond with the translated text nothing else.

Translate the following text to French:

{description}
french-mixtral-8x7b
completed 112 rows48512 tokens$ 0.0340 2 iterations
5a5add4b-3551-47bf-868e-b1dd53ad2180
MetaMeta/Llama 3.1 8B Instructtext → text
Bessie
ox
7 months ago
You are an expert in translating from Spanish to English. Only respond with the translated text nothing else.

Translate the following text to English:

{english_to_spanish}
spanish-llama-8b
spanish-llama-8b
completed 112 rows38880 tokens$ 0.0078 1 iteration
74bf5344-3cc0-48ea-b1a0-1971c7142d5e
MetaMeta/Llama 3.1 70B Instructtext → text
Bessie
ox
7 months ago
You are an expert in translating from Spanish to English. Only respond with the translated text nothing else.

Translate the following text to English:

{english_to_spanish}
spanish-llama-70b
spanish-llama-70b
completed 112 rows40870 tokens$ 0.0368 1 iteration
09ebd1e3-ad05-4bd3-8069-8b7ee5b18285
MetaMeta/Llama 3.1 8B Instructtext → text
Bessie
ox
7 months ago
You are an expert in translating from English to Spanish. Only respond with the translated text nothing else.

Translate the following text to Spanish:

{description}
spanish-llama-8b
completed 112 rows39053 tokens$ 0.0078 1 iteration
9a1b6ac0-95c8-49e0-ab1b-91dea9ed8ef5
MetaMeta/Llama 3.1 70B Instructtext → text
Bessie
ox
7 months ago
You are an expert in translating from English to Spanish. Only respond with the translated text nothing else.

Translate the following text to Spanish:

{description}
spanish-llama-70b
completed 112 rows40254 tokens$ 0.0362 1 iteration
94e4db74-c5af-4cf1-9ad1-b32b3f25c942
OpenAIOpenAI/GPT 4otext → text
Bessie
ox
7 months ago
You are an expert in translating from Spanish to English. Only respond with the translated text nothing else.

Translate the following text to English:

{english_to_spanish}
spanish-gpt-4o
spanish-gpt-4o
completed 112 rows36202 tokens$ 0.1957 1 iteration
b4604a61-8e78-40a5-8b4d-c100bfe7c512
OpenAIOpenAI/GPT 4o minitext → text
Bessie
ox
7 months ago
You are an expert in translating from Spanish to English. Only respond with the translated text nothing else.

Translate the following text to English:

{english_to_spanish}
spanish-gpt-4o-mini
spanish-gpt-4o-mini
completed 112 rows36629 tokens$ 0.0119 1 iteration
da83d146-bd11-4caa-ad16-efe92eea4d77
OpenAIOpenAI/GPT 4otext → text
Bessie
ox
7 months ago
You are an expert in translating from English to Spanish. Only respond with the translated text nothing else.

Translate the following text to Spanish:

{description}
completed 112 rows35666 tokens$ 0.2269 1 iteration
2af0297c-be9c-490c-9776-1a4bf8acac67
OpenAIOpenAI/GPT 4o minitext → text
Bessie
ox
7 months ago
You are an expert in translating from English to Spanish. Only respond with the translated text nothing else.

Translate the following text to Spanish:

{description}
spanish-gpt-4o-mini
completed 112 rows35787 tokens$ 0.0137 2 iterations
202f0e2f-e962-4e55-ab7f-1cbaaedaee8a
MetaMeta/Llama 3.1 405B Instructtext → text
Bessie
ox
7 months ago
You are an expert in translating from Spanish to English. Only respond with the translated text nothing else.

Translate the following text to English:

{english_to_spanish}
completed 112 rows41173 tokens$ 0.1235 2 iterations
d4f2cf91-2241-4703-a36b-7bc8218f9514
MetaMeta/Llama 3.1 405B Instructtext → text
Bessie
ox
7 months ago
You are an expert in translating from English to Spanish. Only respond with the translated text nothing else.

Translate the following text to Spanish:

{description}
completed 112 rows40458 tokens$ 0.1214 4 iterations