For install in Linux:
1.execute in your terminal:
curl -fsSL https://ollama.com/install.sh | sh
2.after that open your browser and check:
check localhost:11434
3.execute in your terminal:
ollama pull llama2
For install Web Interface:
1. execute in your terminal:
sudo apt install apt-transport-https ca-certificates curl software-properties-common -y
sudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
echo "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
sudo apt update
sudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
apt update && apt install python3-distutils -y
apt install python3-setuptools -y
apt update && apt install -y python3-venv python3-setuptools
apt install -y python3-pip
apt install docker-compose
2.execute in your terminal:
sudo docker run -d --network=host -e OLLAMA_BASE_URL=http://127.0.0.1:11434 -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main
3.Run Open WebUI
<your ipaddress>:8080
install some models:
1.if you are want use deekseep, please run:
ollama run deepseel-r1:70b
2.if you want to run a code developer mode please run:
ollama run wizardcoder
Some references:
Running AI Locally Using Ollama on Ubuntu Linux
Ubuntu | Docker Docs
Nenhum comentário:
Postar um comentário