Skip to content

Commit e5321db

Browse files
authored
Revise import times and storage details in README
Updated import times and storage considerations for benchmarks.
1 parent 86141c8 commit e5321db

1 file changed

Lines changed: 4 additions & 3 deletions

File tree

README.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -126,7 +126,7 @@ The [OpenStreetMap website](https://www.openstreetmap.org/export/) allows you to
126126

127127
| Dataset | original | filtered... | time taken | reduction | during import | imported | time taken | reduction |
128128
|------------|----------|-------------|------------|-----------|---------------|----------|------------|-----------|
129-
| Planet | 86 GB | 34 GB | 40 min | ~60% | ~250 GB | ~65 GB | ~85 h | ~25% |
129+
| Planet | 86 GB | 34 GB | 40 min | ~60% | ~250 GB | ~65 GB | ~11 h | ~25% |
130130
| Germany | 4.4 GB | 1.8 GB | 2 min | ~59% | ~14.4 GB | 3,81 GB | ~18 min | ~13% |
131131
| Netherland | 1.4 GB | 394 MB | 30 s | ~70% | ~2,69 GB | 705,7 MB | ~3 min | ~50% |
132132

@@ -137,7 +137,7 @@ The above benchmarks were performed on the following hardware:
137137

138138
- **CPU:** AMD Ryzen 7 5825U with Radeon Graphics (8 cores, 16 threads, 4.5 GHz max)
139139
- **Memory:** 32 GiB system RAM
140-
- **Storage:** ZFS Pool on 4 HDD
140+
- **Storage:** pbf on ZFS Pool on 4 HDD, import folder an nvme drive
141141

142142
**Import Command Used:**
143143
```bash
@@ -156,7 +156,8 @@ thumb is to have swap space at least equal to or larger than the JVM heap size (
156156

157157
**Storage Considerations:**
158158

159-
A fast NVMe drive or RAID configuration significantly improves import times. The import process involves heavy random I/O operations during the RocksDB compaction phase. Slower storage can double or triple import times compared to fast NVMe storage.
159+
A fast NVMe drive or RAID configuration significantly improves import times. The import process involves heavy random I/O operations during the RocksDB compaction phase. Slower storage can double or triple import times compared to fast NVMe storage.
160+
Or put in other words, a Planet-PBF import took 85h on my system when having everything on the ZFS Pool. When putting the import folder on a NVME drive, the whole import took around 11h.
160161

161162
</details>
162163

0 commit comments

Comments
 (0)