ollama

Run Linux command line and gui applications on FreeBSD with full Nvidia Cuda hardware acceleration. https://github.com/NapoleonWils0n/freebsd-cuda Mounts the Linuxulator libraries from Freebsd into the Podman containers, so you dont need to install the Nvidia driver into the container...

I have managed to get Ollama 24 working with Cuda and Podman Using my new project freebsd-cuda ( which im still working on ) I have 4 Podman containers in the project 1) Ollama working with Cuda The models are stored on the Freebsd side in ~/.ollama You enter the podman container and run...

podman install on freebsd for freebsd and linux containers in this video i cover setting up fstab, pf firewall, systl, linux, zfs and podman registries for podman and the differences between freebsd and linux containers and packages and commands you need to be aware of we install searxng is a...

The only limitation is your fantasy now. The model does not refuse - generates anything you ask it for (in testing it did not refuse to answer any of the 465 dangerous queries). Can create anything you want - from porn novels to instructions on how to create a nuclear bomb - at your own risk...

just a heads up ollama doesnt run gemma 3 https://ollama.com/library/gemma3 i pulled down gemma3:4b with ollama to test it start the ollama server OLLAMA_NUM_PARALLEL=1 OLLAMA_DEBUG=1 LLAMA_DEBUG=1 ollama start or ollama serve pull gemma 3 ollama pull gemma3:4b run gemma 3 ollama...

I just installed LLaVa vision model with ollama and tested it with the Freebsd boot sceen https://ollama.com/library/llava pull the model ollama pull llava:7b i downloaded an image from this forum of the boot screen and named it freebsd.png run the prompt ollama run llava "describe this...

Ollama run large language models on your computer including deepseek-r1, deepseek-coder, mistral and zephyr In this video i install Ollama on Freebsd 14.2 on a Dell XPS 15 2019 with a NVIDIA GeForce GTX 1650 gpu with 16 gig of ram on Freebsd 14.2 quarterly release with the 550.127.05 Nvidia...

I have installed the Ollama package on Freebsd 14.2 quarterly on my Dell XPS 15 2019 with a NVIDIA GeForce GTX 1650 and 16 gig of ram ouput of nvidia-smi nv-sglrun nvidia-smi +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 550.127.05...