what AI client we can use it in my freebsd 15 console ?

[fff2024g]

dear all:
i want to install some AI client in my pc , can you show me something ? thanks.
when i meet some problems , i can ask AI first, then ask in this forum to save times. thanks.

 

[cracauer@]

ollama and lama.cpp by default run in a terminal.

An Emacs interface like gptel can also be used.

There is a port for claude-code

 

[MG]

Looking for it now and then. Problem is that AI web services aren't going to interface with something to be nested in a text-interface without any credit. They all seem to make it complicated. It's ofcourse possible to just rip the results from a webpage but I'm not sure if that's legal.

There should actually be a decentral solution like bittorrent but communicating LLM members instead of movie and game sharing. I would give it some local resources.

 

[fff2024g]

ollama and lama.cpp by default run in a terminal.

An Emacs interface like gptel can also be used.

There is a port for claude-code

dear cracauer@ :
thanks. https://anthropic.com/supported-countries has blocked my location. thanks....

 

[cracauer@]

So how about ollama and llama.cpp?

 

[fff2024g]

Dear cracauer@:

ollama-0.13.5_3 Run Llama 2, Mistral, and other large language models
ollama-hpp-0.9.4 Modern, Header-only C++ bindings for the Ollama API
i am not professional. which app i need to install ? then what is my next. thanks. please show me the detail.

 

[cracauer@]

Install the ollama package.

Then:

ollama run --verbose llama3.2:latest

What kind of CPU, GPU and RAM do you have?