reason

Stage 2: Reasoning

Table of Contents

• Installation
• Pre-processed Results for Reproducibility
• Inference with LLMs

Installation

conda create -n reasoner python=3.10.14 -y
conda activate reasoner
pip install torch==2.4.0 --index-url https://download.pytorch.org/whl/cu121
pip install vllm==0.5.5 openai==1.50.2 wandb

Reasoning (Inference)

Using Pre-Processed Retrieval Results for Reproducibility

We provide pre-processed results for reproducibility of the paper experiments. To download them

huggingface-cli download siqim311/SubgraphRAG --revision main --local-dir ./

• scored_triples stores the pre-processed retrieval results.
• results/KGQA stores the reasoning results.

After downloading the pre-processed results, one can run main.py with proper paramerters. For example,

python main.py -d webqsp --prompt_mode scored_100
python main.py -d cwq --prompt_mode scored_100

Using Alternative Retrieval Results

To use alternative retrieval results,

python main.py -d webqsp --prompt_mode scored_100 -p P

where P is the path to the retrieval results obtained from retrieval inference, e.g., ../retrieve/webqsp_Nov08-01:14:47/retrieval_result.pth.

Config

Our used config for each dataset can be found in ./config.