Evaluations/Filter Answerable Questions
main
data/04_interesting-questions.parquet
text → text
MetaMeta/Llama 3.1 8B Instruct
Fireworks AI Fireworks AI
answerable
You are an expert in version control systems and data engineering. Take the following section from the documentation of Oxen AI, a data version control system, as well as a relevant question. If the question is answerable from only the information present in the section, answer with "answerable"; if it is not, answer with "unanswerable". Do not include anything else in your answer. If the section is empty or missing, respond with "unanswerable", as this means there is no information in that section.

Title: <section_title>{section_title}</section_title>
Section: <section>{section}</section>
Question: <question>{question}</question>

Is the question answerable based on the information in the section? If so, answer with "answerable" and otherwise answer with "unanswerable". Do not answer with anything besides answerable/unanswerable, and do not include any additional explanation.
Jan 21, 2025, 9:50 PM UTC
Jan 21, 2025, 9:50 PM UTC
5 row sample
1409 tokens$ 0.0003
5 rows processed, 1409 tokens used ($0.0003)
Estimated cost for all 193 rows: $0.0109
Sample Results completed
8 columns, 1-5 of 193 rows