cuda

Installing ComfyUI and ComfyUI-Manager with Cuda on Freebsd using Podman with the freebsd-cuda project. ComfyUI https://github.com/comfy-org/comfyui ComfyUI-Manager https://github.com/Comfy-Org/ComfyUI-Manager Freebsd Cuda project https://github.com/NapoleonWils0n/freebsd-cuda Freebsd Cuda...

Just installed Comfyui using Podman with Cuda support https://github.com/comfy-org/comfyui Have to installs some models next to try everything out takes a while to download the models Also installed the Comfyui manager https://github.com/Comfy-Org/ComfyUI-Manager

Kokoro-onnx for text to speech with Cuda on Freebsd with Emacs Using a simple python script to create an api using fastapi and uvicorn we can use kokoro-onnx using curl on the command line or using emacs and a couple of lines of elisp code Cuda support on Freebsd using podman Note you...

I have created a Podman container for Kokoro-onnx with Cuda support Kokoro-onnx is a light weight tts for text to speech I have also knocked up a simple python script that lets you specify a text file, voice to use and optionally an output file name Features: Supports multiple languages...

Run Linux command line and gui applications on FreeBSD with full Nvidia Cuda hardware acceleration. I have also posted this in the how to section But that has comments disabled by default from memory mods i created another thread so people post comments and you dont have to approve them in...

Run Linux command line and gui applications on FreeBSD with full Nvidia Cuda hardware acceleration. https://github.com/NapoleonWils0n/freebsd-cuda Mounts the Linuxulator libraries from Freebsd into the Podman containers, so you dont need to install the Nvidia driver into the container...

I have managed to get Ollama 24 working with Cuda and Podman Using my new project freebsd-cuda ( which im still working on ) I have 4 Podman containers in the project 1) Ollama working with Cuda The models are stored on the Freebsd side in ~/.ollama You enter the podman container and run...

I now have Cuda working on Freebsd using a Rocky Linux Podman container This is the python command run inside the Podman container python3 -c "import torch; print('CUDA Available:', torch.cuda.is_available()); print('Device:', torch.cuda.get_device_name(0) if torch.cuda.is_available() else...

Freebsd Firefox Widevine for drm playback now working in a Rocky Linux Podman container No Nvidia driver installed in the Podman container works by mounting the Linuxulator directories for the Nvidia drivers from Freebsd to the Podman container Hardware accelerated video playback persistent...

Good morning FreeBSD community! I am traditionally a Linux user and moved to FreeBSD a little more than a year, and man.... I loved it! It is some of those moments we say "how have a lived until now without it?". But it is with broken heart that I am planning to move back to Linux as I...

Just upgraded to the latest quarterly branch and the nvidia driver and cuda have got an upgrade Nvidia 570.124.04 and Cuda 12.8 im going install the matching Nvidia driver in a Rocky Linux jail with the nvidia-cuda-toolkit 12.8 and see if i can get cuda working in the jail cuda in a jail...

I have installed the Ollama package on Freebsd 14.2 quarterly on my Dell XPS 15 2019 with a NVIDIA GeForce GTX 1650 and 16 gig of ram ouput of nvidia-smi nv-sglrun nvidia-smi +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 550.127.05...

the libc6-shim package installs a program called nv-slgrun which can be used with various applications to enable nvenc encoding and cuda for example osb studio, ffmpeg, handbrake, blender nv-slgrun was working with the nvidia 535 driver which let you use nvenc encoding with obs studio and...

Hello to everyone. I've just read this thread : https://forums.developer.nvidia.com/t/cuda-and-nv-un-register-os-un-lock-user-pages/174678/13 where has been asked to modify the code of the freebsd driver to support CUDA. I read that it has been done. So,now can we install CUDA on FreeBSD by...

% pwd /usr/home/grahamperrin/dev/gpufetch % echo $0 /bin/tcsh % ./build.sh -- The CXX compiler identification is Clang 13.0.0 -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /usr/bin/c++ - skipped -- Detecting CXX compile features...

Hi, I am an intermediate FreeBSD ( mostly server-side ) and Docker user. I am trying to migrate more of my stuff from Linux to FreeBSD. But I need a functionality of Docker that I don't know if it exists in FreeBSD jails. First, I have read about jails a fair bit and I have found infos about...