llama.cpp

  1. adriel-tech

    llama.cpp AI working in a jail using Nvidia GPU

    Hello, Previously I tried to use Ollama on FreeBSD with my Nvidia GPU and it did not work, it uses CPU only, on the host or in a jail. Recently I have been using llama.cpp (version 8182, 28 Feb 2026) in a jail with Nvidia GPU support without issue, I will dump some notes for experienced users...
    • adriel-tech
    • Thread
    • llama llama.cpp llama_server nvidia
    • Replies: 2
    • Forum: General
Back
Top