Skip to content

Commit 1548807

Browse files
committed
docs: more details on cc-downloader
1 parent 11b4af7 commit 1548807

1 file changed

Lines changed: 7 additions & 3 deletions

File tree

README.md

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -554,14 +554,18 @@ In case you want to run many of these queries, and you have a lot of disk space,
554554
> [!IMPORTANT]
555555
> If you happen to be using the Common Crawl Foundation development server, we've already downloaded these files, and you can run ```make duck_ccf_local_files```
556556
557-
To download the crawl index, please use [cc-downloader](https://github.com/commoncrawl/cc-downloader), which is a polite downloader for Common Crawl data:
557+
To download the crawl index, please use [cc-downloader](https://github.com/commoncrawl/cc-downloader), which is the official and recommended downloader for Common Crawl data.
558558

559+
The simplest way to install `cc-downloader` is through cargo, the Rust package manager. If you have Rust installed, you can run:
560+
559561
```shell
560562
cargo install cc-downloader
561563
```
562564

563-
`cc-downloader` will not be set up on your path by default, but you can run it by prepending the right path.
564-
If cargo is not available or does not install, please check on [the cc-downloader official repository](https://github.com/commoncrawl/cc-downloader).
565+
> [!WARNING]
566+
> `cc-downloader` will not be set up on your path by default, but you can run it by prepending the right path.
567+
568+
If cargo is not available or does not install, you can download the binaries, please check on [the cc-downloader official repository](https://github.com/commoncrawl/cc-downloader).
565569

566570
```shell
567571
mkdir crawl

0 commit comments

Comments
 (0)