Hi after reviewing most of the suggestions from MS and NV, and surfing the web, I can not get nvtop to see my GPU. Ollama saw the GPU and used but nvtop failed to see it?
Here is some information about the setup of my machine:
wsl --version
Versión de WSL: 2.3.24.0
Versión de kernel: 5.15.153.1-2
Versión de WSLg: 1.0.65
Versión de MSRDC: 1.2.5620
Versión de Direct3D: 1.611.1-81528511
Versión DXCore: 10.0.26100.1-240331-1435.ge-release
Versión de Windows: 10.0.22631.4169
$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Thu_Nov_18_09:45:30_PST_2021
Cuda compilation tools, release 11.5, V11.5.119
Build cuda_11.5.r11.5/compiler.30672275_0
$ nvidia-smi
Fri Oct 4 13:57:04 2024
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.51.01 Driver Version: 565.90 CUDA Version: 12.7 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=====================================+========================+======================|
| 0 NVIDIA GeForce RTX 4090 On | 00000000:05:00.0 On | Off |
| 0% 49C P8 10W / 450W | 1536MiB / 24564MiB | 5% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+----------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=====================================================================================|
| 0 N/A N/A 26 G /Xwayland N/A |
+-----------------------------------------------------------------------------------------+
$ curl -fsSL https://ollama.com/install.sh | sh
Installing ollama to /usr/local
Downloading Linux amd64 bundle
######################################################################## 100.0%##O=# #
######################################################################## 100.0%
Adding ollama user to render group...
Adding ollama user to video group...
Adding current user to ollama group...
Creating ollama systemd service...
Enabling and starting ollama service...
Nvidia GPU detected.
The Ollama API is now available at 127.0.0.1:11434.
Install complete. Run "ollama" from the command line.
mywsl@Galileo:~$ ollama run llama3.2:3b
Good morning
Good morning! How can I assist you today?
$ nvtop -v -> nvtop version 1.2.2
$ nvtop -> No GPU to monitor.
Do you have any suggestions about how to fix the problem? Have I missed something?
Many thanks for considering my request.
Hi after reviewing most of the suggestions from MS and NV, and surfing the web, I can not get nvtop to see my GPU. Ollama saw the GPU and used but nvtop failed to see it?
Here is some information about the setup of my machine:
$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Thu_Nov_18_09:45:30_PST_2021
Cuda compilation tools, release 11.5, V11.5.119
Build cuda_11.5.r11.5/compiler.30672275_0
$ nvidia-smi
Fri Oct 4 13:57:04 2024
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.51.01 Driver Version: 565.90 CUDA Version: 12.7 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=====================================+========================+======================|
| 0 NVIDIA GeForce RTX 4090 On | 00000000:05:00.0 On | Off |
| 0% 49C P8 10W / 450W | 1536MiB / 24564MiB | 5% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+----------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=====================================================================================|
| 0 N/A N/A 26 G /Xwayland N/A |
+-----------------------------------------------------------------------------------------+
$ curl -fsSL https://ollama.com/install.sh | sh
$ nvtop -v -> nvtop version 1.2.2
$ nvtop -> No GPU to monitor.
Do you have any suggestions about how to fix the problem? Have I missed something?
Many thanks for considering my request.