Phi Model Setup

Set Up Hugging Face Access

As root:

cd /opt/dev
python3 -m venv huggingface-venv
source ./huggingface-venv/bin/activate
pip install --upgrade pip
pip install huggingface_hub
cd /opt/src/llama.cpp
pip install -r requirements.txt

Download Phi

This is BIG, so it will take a while.

hf download microsoft/Phi-4-mini-instruct \
    --local-dir /opt/dev/Phi-4-mini-instruct