Evaluations
Run models against your data
Introducing Evaluations, a powerful feature designed to enable you to effortlessly test and compare a selection of AI models against your datasets.
Whether you're fine-tuning models or evaluating performance metrics, Oxen evaluations simplifies the process, allowing you to quickly and easily run prompts through an entire dataset.
Once you're happy with the results, output the resulting dataset to a new file, another branch, or directly as a new commit.
12be36d7-414a-440e-9524-e14661e9ddc3
Anthropic AIAnthropic AI/Claude 3.7 Sonnettexttext
realityinspector
realityinspector
4 months ago
please say "{data}"
error protocol String.Chars not implemented for %{"active" => true, "adprs_params" => %{"communication" => %{"A" => 0.7303320079003653, "D" => 2.0440801815462235, "P" => 10.925688534410254, "S" => 0.04075882725252407}, "consumption" => %{"A" => 0.898979958044237, "D" => 7.655178991764933, "P" => 16.271034513125265, "S" => 0.12341204589647044}, "engagement" => %{"A" => 0.8198286247648684, "D" => 4.396251886656752, "P" => 7.092823920885784, "S" => 0.1908683209864359}, "publication" => %{"A" => 0.8076256624620295, "D" => 9.730234973237556, "P" => 11.136224092630902, "S" => 0.05244940757760017}}, "behavioral" => [1.5352948701815796, 0.7076361739348833, 1.282115275081388, -1.542314823620094, -1.4543400152403052], "demographic" => [-0.6755041671194197, 1.004686335003698, 0.030613939260194737, -1.3115628106303951, 1.0755025915537093], "energy" => 34.902236435299045, "id" => 0, "psychographic" => [-0.16707343313790357, -0.12345944063580828, 0.0740192121241714, 0.10144018166482738, 1.2672881257784354], "relational" => [1.4873303781993457, -1.6756892630545774, 1.8672834568432553, -0.034758749367909125, 1.7150513669781358], "type" => "person"} of type Map. This protocol is implemented for the following type(s): Atom, BitString, Date, DateTime, Decimal, Explorer.Duration, Float, Integer, List, NaiveDateTime, Phoenix.LiveComponent.CID, Postgrex.Copy, Postgrex.Query, Time, URI, Version, Version.Requirement Waiting... 0 tokens$ 0.0000 5 iterations
57fa006f-df77-4793-bd93-e3cad27209c7
OpenAIOpenAI/GPT 4o minitexttext
realityinspector
realityinspector
4 months ago
{data}
error protocol String.Chars not implemented for %{"active" => true, "adprs_params" => %{"communication" => %{"A" => 0.7303320079003653, "D" => 2.0440801815462235, "P" => 10.925688534410254, "S" => 0.04075882725252407}, "consumption" => %{"A" => 0.898979958044237, "D" => 7.655178991764933, "P" => 16.271034513125265, "S" => 0.12341204589647044}, "engagement" => %{"A" => 0.8198286247648684, "D" => 4.396251886656752, "P" => 7.092823920885784, "S" => 0.1908683209864359}, "publication" => %{"A" => 0.8076256624620295, "D" => 9.730234973237556, "P" => 11.136224092630902, "S" => 0.05244940757760017}}, "behavioral" => [1.5352948701815796, 0.7076361739348833, 1.282115275081388, -1.542314823620094, -1.4543400152403052], "demographic" => [-0.6755041671194197, 1.004686335003698, 0.030613939260194737, -1.3115628106303951, 1.0755025915537093], "energy" => 34.902236435299045, "id" => 0, "psychographic" => [-0.16707343313790357, -0.12345944063580828, 0.0740192121241714, 0.10144018166482738, 1.2672881257784354], "relational" => [1.4873303781993457, -1.6756892630545774, 1.8672834568432553, -0.034758749367909125, 1.7150513669781358], "type" => "person"} of type Map. This protocol is implemented for the following type(s): Atom, BitString, Date, DateTime, Decimal, Explorer.Duration, Float, Integer, List, NaiveDateTime, Phoenix.LiveComponent.CID, Postgrex.Copy, Postgrex.Query, Time, URI, Version, Version.Requirement Waiting... 0 tokens$ 0.0000 1 iteration
7dd85407-ab1c-45d7-a624-4014e12d1284
MetaMeta/Llama 3.1 8B Instruct Turbotexttext
realityinspector
realityinspector
4 months ago
what is this?
{type}
{data}
error protocol String.Chars not implemented for %{"active" => true, "adprs_params" => %{"communication" => %{"A" => 0.7303320079003653, "D" => 2.0440801815462235, "P" => 10.925688534410254, "S" => 0.04075882725252407}, "consumption" => %{"A" => 0.898979958044237, "D" => 7.655178991764933, "P" => 16.271034513125265, "S" => 0.12341204589647044}, "engagement" => %{"A" => 0.8198286247648684, "D" => 4.396251886656752, "P" => 7.092823920885784, "S" => 0.1908683209864359}, "publication" => %{"A" => 0.8076256624620295, "D" => 9.730234973237556, "P" => 11.136224092630902, "S" => 0.05244940757760017}}, "behavioral" => [1.5352948701815796, 0.7076361739348833, 1.282115275081388, -1.542314823620094, -1.4543400152403052], "demographic" => [-0.6755041671194197, 1.004686335003698, 0.030613939260194737, -1.3115628106303951, 1.0755025915537093], "energy" => 34.902236435299045, "id" => 0, "psychographic" => [-0.16707343313790357, -0.12345944063580828, 0.0740192121241714, 0.10144018166482738, 1.2672881257784354], "relational" => [1.4873303781993457, -1.6756892630545774, 1.8672834568432553, -0.034758749367909125, 1.7150513669781358], "type" => "person"} of type Map. This protocol is implemented for the following type(s): Atom, BitString, Date, DateTime, Decimal, Explorer.Duration, Float, Integer, List, NaiveDateTime, Phoenix.LiveComponent.CID, Postgrex.Copy, Postgrex.Query, Time, URI, Version, Version.Requirement Waiting... 0 tokens$ 0.0000 2 iterations