Oxen.ai allows you to run models row by row over your datasets. This allows you to label data, or evaluate how well a model is performing. Once the model has run over your dataset, you can save the output to a new file or branch, comparing it to the original dataset.

Consider the given question and two answers. The first answer is the gold standard, correct answer. The second answer may or may not be correct. Compare the text in the two answers and determine whether the second answer is correct. Provide a brief explanation for why the answer is correct or not before arriving at the final verdict (Yes/No). Provide a final verdict for whether the second answer is correct the end in the given format:
Is Correct:
Yes
or
Is Correct:
No
Do not deviate from the specified format for the final verdict.
Question:
{question}
First Answer:
{answer}
Second Answer:
{prediction}
Consider the given question and two answers. The first answer is the gold standard, correct answer. The second answer may or may not be correct. Compare the text in the two answers and determine whether the second answer is correct. Provide a brief explanation for why the answer is correct or not before arriving at the final verdict (Yes/No). Provide a final verdict for whether the second answer is correct the end in the given format:
Is Correct:
Yes
or
Is Correct:
No
Do not deviate from the specified format for the final verdict.
Question:
{question}
First Answer:
{answer}
Second Answer:
{prediction}
pretend you are a medical professional answer the following question
{question}
Consider the given question and two answers. The first answer is the gold standard, correct answer. The second answer may or may not be correct. Compare the text in the two answers and determine whether the second answer is correct. Provide a brief explanation for why the answer is correct or not before arriving at the final verdict (Yes/No). Provide a final verdict for whether the second answer is correct the end in the given format:
Is Correct:
Yes
or
Is Correct:
No
Do not deviate from the specified format for the final verdict.
Question:
{question}
First Answer:
{answer}
Second Answer:
{prediction}

Consider the given question and two answers. The first answer is the gold standard, correct answer. The second answer may or may not be correct. Compare the text in the two answers and determine whether the second answer is correct. Provide a brief explanation for why the answer is correct or not before arriving at the final verdict (Yes/No). Provide a final verdict for whether the second answer is correct the end in the given format:
Is Correct:
Yes
or
Is Correct:
No
Do not deviate from the specified format for the final verdict.
Question:
{question}
First Answer:
{answer}
Second Answer:
{prediction}
You are a medical professional who is helping a patient. Patients will ask you questions and you will answer them in plain English so that anyone can understand.
{question}