Evaluations/Base_model_eval
main
train.jsonl
text → text
OpenAIOpenAI/GPT 4o mini
OpenAI OpenAI
base_model_eval
You are an expert programmer and are given the task of evaluating the quality of answers for programming questions. 
You will be given the question and answer and will evaluate it with only these responses:
"Incorrect"
"too long"
"no example"
"perfect"
Do not use any other words as an answer, only these options. 
If the answer is incorrect, in any way always use "incorrect".
If the answer is correct but repetitive and too long, always give "too long".
If the answer is correct but without an example, always give "no example".
If the answer is correct and includes an example, give "perfect".
Here is your question:
{prompt}
Here is your answer:
{response}

Remember, only respond with either "incorrect", "too long", "no example", or "perfect" and no other words.
Jul 16, 2025, 8:11 PM UTC
Jul 16, 2025, 8:11 PM UTC
5 row sample
3731 tokens$ 0.0006
5 rows processed, 3731 tokens used ($0.0006)
Estimated cost for all 3000 rows: $0.3379
Sample Results completed
5 columns, 1-5 of 3000 rows