terça-feira, 4 de fevereiro de 2025

How to install the IA in your own computer - linux

For install in Linux:

1.execute in your terminal:

    curl -fsSL https://ollama.com/install.sh | sh

2.after that open your browser and check:

    check localhost:11434

3.execute in your terminal:
    ollama pull llama2

For install Web Interface:

1. execute in your terminal:
sudo apt install apt-transport-https ca-certificates curl software-properties-common -y
sudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
echo "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
sudo apt update
    
sudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
apt update && apt install python3-distutils -y
apt install python3-setuptools -y
apt update && apt install -y python3-venv python3-setuptools
apt install -y python3-pip

apt install docker-compose

2.execute in your terminal:
    sudo docker run -d --network=host -e OLLAMA_BASE_URL=http://127.0.0.1:11434 -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main    
3.Run Open WebUI
<your ipaddress>:8080

install some models:

1.if you are want use deekseep, please run:
ollama run deepseel-r1:70b
2.if you want to run a code developer mode please run:
ollama run wizardcoder
Some references:
Running AI Locally Using Ollama on Ubuntu Linux
Ubuntu | Docker Docs

Nenhum comentário:

Postar um comentário