Arxiv

arXiv is an open-access archive for 2 million scholarly articles in the fields of physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering and systems science, and economics.

Installation and Setup

First, you need to install arxiv python package.

pip

pip install arxiv

Second, you need to install PyMuPDF python package which transforms PDF files downloaded from the arxiv.org site into the text format.

pip

pip install pymupdf

Document Loader

See a usage example.

from langchain_community.document_loaders import ArxivLoader

Retriever

See a usage example.

from langchain_community.retrievers import ArxivRetriever