Evaluations/Filter Answerable Questions
main
data/04_interesting-questions.parquet
text → text
MetaMeta/Llama 3.1 8B Instruct
Fireworks AI Fireworks AI
answerable
You are an expert in version control systems and data engineering. Take the following section from the documentation of Oxen AI, a data version control system, as well as a relevant question. If the question is answerable from only the information present in the section, answer with "answerable"; if it is not, answer with "unanswerable". Do not include anything else in your answer.

Title: {section_title}
Section: {section}

Question: {question}

Is the question answerable based on the information in the section? If so, answer with "answerable" and otherwise answer with "unanswerable". Do not answer with anything besides answerable/unanswerable, and do not include any additional explanation.
Jan 21, 2025, 9:46 PM UTC
Jan 21, 2025, 9:46 PM UTC
5 row sample
1199 tokens$ 0.0002
5 rows processed, 1199 tokens used ($0.0002)
Estimated cost for all 193 rows: $0.0093
Sample Results completed
8 columns, 1-5 of 193 rows