Repository evaluations - Laurence/Arxiv-Dive-RAG

Laurence/

Arxiv-Dive-RAG

Data Branches Evaluations Notebooks Fine tune

Evaluations/test r1

main

data/05_answerable_questions.parquet

Type: text → text

Model:

Meta/Llama 3.1 70B Instruct

Provider:

Fireworks AI

Target field: test

Prompt

<instructions>
Answer the question based on the given documentation section titled {title}.
</instructions>

<documentation>
{section}
</documentation>

<question>
{question}
</question>

Queued: Jan 24, 2025, 9:49 PM UTC

Completed: Jan 24, 2025, 9:49 PM UTC

5 row sample

2647 tokens$ 0.0024

5 rows processed, 2647 tokens used ($0.0024)

Estimated cost for all 68 rows: $0.0324

Sample Results completed

9 columns, 1-5 of 68 rows