Skip to content

Commit 4622e74

Browse files
Small Changes for SCDL release (#1051)
1. Adding to README 2. pin to correct bionemo-core 3. update SCDL version --------- Signed-off-by: Polina Binder <pbinder@nvidia.com>
1 parent a59ce63 commit 4622e74

4 files changed

Lines changed: 4 additions & 8 deletions

File tree

sub-packages/bionemo-scdl/README.md

Lines changed: 2 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -163,13 +163,9 @@ convert_h5ad_to_scdl --data-path hdf5s --save-path example_dataset
163163

164164
## Runtimes with SCDL
165165

166-
The runtime and memory usage are examined on a CellXGene Dataset with ~1.5 million rows and a size of 24 GB. On this dataset, there is a 4.9x memory speed up.
166+
The runtime is examined on the Tahoe 100M dataset, which containes over 100 million rows. On this dataset, there is either a 12x or 53x speed up depending on the machine used.
167167

168-
![Throughput Image](https://raw.githubusercontent.com/NVIDIA/bionemo-framework/main/sub-packages/bionemo-scdl/assets/throughput.png)
169-
170-
Additionally, the peak memory usage when iterating over the datasets with the SCDL dataloader is only 36.5 MB, since the whole dataset is never loaded into memory due to the numpy memomory-mapped backing.
171-
172-
![Memory Image](https://raw.githubusercontent.com/NVIDIA/bionemo-framework/main/sub-packages/bionemo-scdl/assets/disk_space.png)
168+
![Throughput](https://raw.githubusercontent.com/NVIDIA/bionemo-framework/pbinder/scdl_add_to_edawson/sub-packages/bionemo-scdl/assets/tahoe_throughput.png)
173169

174170
### Using Neighbor Information in Single Cell Datasets
175171

sub-packages/bionemo-scdl/VERSION

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
0.0.7
1+
0.1.0
102 KB
Loading

sub-packages/bionemo-scdl/pyproject.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ dependencies = [
2323

2424
[project.optional-dependencies]
2525
test = [
26-
"bionemo-core>=2.4.0",
26+
"bionemo-core>=2.4.5",
2727
'pytest>=8.4.1'
2828
]
2929

0 commit comments

Comments
 (0)