arxiv_markdown_chunks_are_interesting.parquet8.3 mb
add filter for if the chunks are interesting
1 year ago arxiv_questions.parquet600 B
add script to generate questions based on the arxiv papers
1 year ago arxiv_markdown.parquet2.1 mb
Updated "title_embedding" with text-embedding-3-small
1 year ago arxiv_markdown_chunks.parquet8.6 mb
Computing embeddings for paper sections
1 year ago