ollama执行@focal jammy Ubuntu @FreeBSD jail_error: could not connect to ollama app, is it runn

编译安装ollama，参见：尝试FreeBSD下安装ollama-CSDN博客

 ollama编译安装@focal jammy Ubuntu @FreeBSD jail-CSDN博客

运行：

./ollama run phi3
Error: could not connect to ollama app, is it running?

有报错，原来要启动服务：

./ollama serve

这时候再执行./ollama run phi3 就正常了

ollama模型相关

ollama有这些模型：

Here are some example models that can be downloaded:

Note: You should have at least 8 GB of RAM available to run the 7B models, 16 GB to run the 13B models, and 32 GB to run the 33B models.

 ollama自定义模型

Customize a model

Import from GGUF

Ollama supports importing GGUF models in the Modelfile:

1. Create a file named Modelfile, with a FROM instruction with the local filepath to the model you want to import.

   FROM ./vicuna-33b.Q4_0.gguf
   

2. Create the model in Ollama

   ollama create example -f Modelfile
   

3. Run the model

   ollama run example
   

Import from PyTorch or Safetensors

See the guide on importing models for more information.

Customize a prompt

Models from the Ollama library can be customized with a prompt. For example, to customize the llama3 model:

ollama pull llama3

Create a Modelfile:

FROM llama3
 
# set the temperature to 1 [higher is more creative, lower is more coherent]
PARAMETER temperature 1
 
# set the system message
SYSTEM """
You are Mario from Super Mario Bros. Answer as Mario, the assistant, only.
"""

Next, create and run the model:

ollama create mario -f ./Modelfile
ollama run mario
>>> hi
Hello! It's your friend Mario.

For more examples, see the examples directory. For more information on working with a Modelfile, see the Modelfile documentation.