Repository evaluations - Laurence/Arxiv-Dive-RAG

Laurence/

Arxiv-Dive-RAG

Data Branches Evaluations Notebooks Fine tune

Evaluations/test r1

main

data/05_answerable_questions.parquet

Type: text → text

Model:

DeepSeek/Deepseek R1

Provider:

Fireworks AI

Target field: test

Prompt

<instructions>
Answer the question based on the given documentation section titled {title}.
</instructions>

<documentation>
{section}
</documentation>

<question>
{question}
</question>

Queued: Jan 24, 2025, 7:41 PM UTC

Completed: Jan 24, 2025, 7:55 PM UTC

25 row sample

23595 tokens$ 0.1888

25 rows processed, 23595 tokens used ($0.1888)

Estimated cost for all 68 rows: $0.5134

Sample Results completed

9 columns, 1-25 of 68 rows