Skip to content

Commit f461c79

Browse files
committed
docs: Add GPU acceleration support details for embedding models
1 parent 4d51087 commit f461c79

1 file changed

Lines changed: 14 additions & 0 deletions

File tree

docs/source/content/installation.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,3 +15,17 @@ Download the example data set from [Zenodo](https://zenodo.org/records/15789063)
1515

1616
Additionally, a plugin for this data set can be downloaded from the [official release page](https://github.com/Paulanerus/TextExplorer/releases/latest) (demo.jar).
1717
Both plugins and data sets can be loaded directly within the application, as documented [here](usage.md).
18+
19+
## Using Embeddings Models on the GPU
20+
21+
By default, the application runs embedding models for semantic queries on the CPU, which may result in longer loading times depending on the model, data size, and hardware. GPU acceleration generally reduces these loading times. Below is a list of supported platforms for GPU acceleration:
22+
23+
### NVIDIA GPUs
24+
GPU acceleration supported using CUDA. Requires CUDA 12.x installed. Available on Linux and Windows.
25+
For installation, see [CUDA Toolkit](https://developer.nvidia.com/cuda-downloads).
26+
27+
### AMD GPUs
28+
Currently not supported, but planned.
29+
30+
### Apple GPUs
31+
Not supported, no plans soon.

0 commit comments

Comments
 (0)