Im not really sure, but i think i have cuda running.
When i was installing ollama i got this:
and if i go trough logs:
Cuda is used ? I think so.
When i was installing ollama i got this:
>>> NVIDIA GPU installed.
and if i go trough logs:
Code:
Feb 06 22:19:27 debian-bhyve ollama[842]: llama_load_model_from_file: using device CUDA0 (NVIDIA TITAN V JHH Special Edition) - 32189 MiB free