ollma3部署记录_olamma3

---

created: ‘2024-04-23’

下载 Fetching Title#pmbv

curl -fsSL https://ollama.com/install.sh | sh
1

or

sudo curl -L https://ollama.com/download/ollama-linux-amd64 -o /usr/bin/ollama
sudo chmod +x /usr/bin/ollama
1
2
3
4

Create a user for Ollama:

sudo useradd -r -s /bin/false -m -d /usr/share/ollama ollama
1
2

Create a service file in /etc/systemd/system/ollama.service:

[Unit]
Description=Ollama Service
After=network-online.target

[Service]
ExecStart=/usr/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3

[Install]
WantedBy=default.target

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

Then start the service:

sudo systemctl daemon-reload

sudo systemctl start ollama

sudo systemctl enable ollama

1
2
3
4
5
6

Install CUDA drivers

run

Uninstall
Remove the ollama service:

sudo systemctl stop ollama
sudo systemctl disable ollama
sudo rm /etc/systemd/system/ollama.service
1
2
3

Remove the ollama binary from your bin directory (either /usr/local/bin, /usr/bin, or /bin):

sudo rm $(which ollama)
1

Remove the downloaded models and Ollama service user and group:

sudo rm -r /usr/share/ollama
sudo userdel ollama
sudo groupdel ollama
1
2
3