Status-Report : Nvidia driver 595:99.02.150102 appears to be more stable than its predessesor 595.91 . With 595.91 I had kernel panics when trying to use DRM-612. With 595.99 DRM-612 starts and works again. ( using a desktop based on i7-11700K...
Well, I figured the easiest way would be to upgrade the linux-nvidia-libs to 595.99.02 since FreeBSD Ports Search lists it.
However after doing the below I am confused.
git pull
git status
On branch main
Your branch is up to date with 'origin/main'.
ls x11/linux-nvidia-libs*...
looks like you have a mismatch between the driver version and the libraries
you could try updating and reinstalling the drivers
maybe something like this
sudo pkg update
sudo pkg upgrade linux-nvidia-libs nvidia-driver
and rebooting
No, it's in the container.
I have rebuilt base x11 and ollama but still same.
Logs now say this:
sudo podman-compose logs -f
chmod: changing permissions of '/run/user/1001-writeable': Operation not permitted
chown: cannot read directory '/run/user/1001-writeable': Permission denied
/grandpa
is that nvidia-smi output on the freebsd side
if you google "freebsd NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver."
there are some hits the first one for freebsd...
I did sudo pkg install x11/linux-nvidia-libs and that gave this output from nvidia-smi so small step forward. Still no cuda in ollama though. Maybe rebuild base?
bash-5.1$ nvidia-smi
NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA...
what are the permission on /dev/nvidia
ls -l /dev/nvidia*
the devfs.rules change the permissions to this
crw-rw---- 1 root video 0xad 9 Sep 11:53 /dev/nvidia-modeset
crw-rw---- 1 root video 0xab 9 Sep 11:53 /dev/nvidia0
crw-rw---- 1 root video 0xac 9 Sep 11:53 /dev/nvidiactl
and the...
...video
add path 'drm/*' mode 0660 group video
add path 'input/*' mode 0660 group video
add path 'input/event*' mode 0660 group video
add path 'nvidia*' mode 0660 group video
[devfsrules_jail=4]
add include $devfsrules_unhide_basic
add include $devfsrules_unhide_login
add path 'mixer*' unhide...
...video
add path 'drm/*' mode 0660 group video
add path 'input/*' mode 0660 group video
add path 'input/event*' mode 0660 group video
add path 'nvidia*' mode 0660 group video
[devfsrules_jail=4]
add include $devfsrules_unhide_basic
add include $devfsrules_unhide_login
add path 'mixer*' unhide...
...line jail_devfs_ruleset="5" in /usr/local/etc/containers/container.conf and changed /etc/devfs.rules to your default but still get
bash-5.1$ nvidia-smi
bash: nvidia-smi: command not found
Mind you - I have NOT added devfs_system_ruleset="localrules" to /etc/rc.conf because if I do this pc...
BSD Jedi has some Ollama tutorial and a new one with a plug for some budget option cloud models.
I run 16GB vRAM nvidia on Debian Linux Ollama - rarely used, mainly as brain for Home Assistant....for fun.
I have good experience with Mixture of Experts models - gemma4. They really seem to use...
...add path 'dri*' unhide
add path 'dri/*' mode 0660 group video
add path 'drm*' unhide
add path 'drm/*' mode 0660 group video
add path 'nvidia*' unhide
add path 'nvidia*' mode 0660 group video
add path 'input/*' mode 0660 group video
add path 'input/event*' mode 0660 group video
add path...
that rules those out then
bash: nvidia-smi: command not found
looks like a devfs issue
you seem to be missing this in devfs.rules
[devfsrules_jail=4]
add include $devfsrules_unhide_basic
add include $devfsrules_unhide_login
add path 'mixer*' unhide
add path 'dsp*' unhide
add path 'dri*'...
Tested in a Rocky Linux Podman container and it works
bash-5.1$ ./hello-world-cuda2
Using device: NVIDIA GeForce GTX 1650
Hello, World! from thread 4 (block 1, thread 0)
Hello, World! from thread 5 (block 1, thread 1)
Hello, World! from thread 6 (block 1, thread 2)
Hello, World! from thread 7...
...or tmux pane enter the container again
cd ~/podman/freebsd-cuda/containers/ai/ollama
sudo podman exec -it -u ${USER} ollama /bin/bash
run nvidia-smi
nvidia-smi
the output should look like this
bash-5.1$ nvidia-smi
Wed Sep 9 12:09:42 2026...
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.
