Repository evaluations - Laurence/Arxiv-Dive-RAG

Laurence/

Arxiv-Dive-RAG

Data Branches Evaluations Notebooks Fine tune

Evaluations/test r1

main

data/05_answerable_questions.parquet

Type: text → text

Model:

Qwen/Qwen 2.5 Coder 32B Instruct

Provider:

Fireworks AI

Target field: test

Prompt

<instructions>
Answer the question based on the given documentation section titled {title}.
</instructions>

<documentation>
{section}
</documentation>

<question>
{question}
</question>

Queued: Jan 24, 2025, 7:25 PM UTC

Completed: Jan 24, 2025, 7:26 PM UTC

25 row sample

14731 tokens$ 0.0133

25 rows processed, 14731 tokens used ($0.0133)

Estimated cost for all 68 rows: $0.0361

Sample Results completed

9 columns, 1-25 of 68 rows