Skip to content

Commit 241f5b7

Browse files
kevalmorabia97danielkorzekwa
authored andcommitted
Change cnn_dailymail to abisee/cnn_dailymail (#819)
cnn_dailymail is changed to abisee/cnn_dailymail long ago. Perhaps older name no longer works <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **Chores** * Updated dataset configuration path for improved dataset access. <sub>✏️ Tip: You can customize this high-level summary in your review settings.</sub> <!-- end of auto-generated comment: release notes by coderabbit.ai --> --------- Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
1 parent d810d52 commit 241f5b7

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

examples/llm_sparsity/weight_sparsity/data_prep.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@
1919

2020
from datasets import load_dataset
2121

22-
dataset_id = "cnn_dailymail"
22+
dataset_id = "abisee/cnn_dailymail"
2323
dataset_config = "3.0.0"
2424
text_column = "article"
2525
summary_column = "highlights"

examples/llm_sparsity/weight_sparsity/hf_pts.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@ def get_calib_dataloader(
3535
):
3636
print("Loading calibration dataset")
3737
if data == "cnn_dailymail":
38-
dataset = load_dataset("cnn_dailymail", name="3.0.0", split="train")
38+
dataset = load_dataset("abisee/cnn_dailymail", name="3.0.0", split="train")
3939
dataset = dataset["article"][:calib_size]
4040
else:
4141
raise NotImplementedError

modelopt/torch/utils/dataset_utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -73,7 +73,7 @@
7373
"preprocess": lambda sample: "\n".join(turn["value"] for turn in sample["conversations"]),
7474
},
7575
"cnn_dailymail": {
76-
"config": {"path": "cnn_dailymail", "name": "3.0.0", "split": ["train"]},
76+
"config": {"path": "abisee/cnn_dailymail", "name": "3.0.0", "split": ["train"]},
7777
"preprocess": lambda sample: sample["article"],
7878
},
7979
"pile": {

0 commit comments

Comments
 (0)