在Ubuntu Linux安装brew 使用brew安装llama.cpp 运行文心Ernie大模型
经常用Mac的都知道brew,是Mac下的包管理软件。其实这个包管理软件也可以安装在Linux系统,进而可以用brew管理和安装linux软件包。
安装brew
直接安装
直接用下面命令安装即可,注意需要用管理员权限
/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)" 配置环境变量
安装完成,提示配置环境变量:
echo >> /root/.bashrc echo 'eval "$(/home/linuxbrew/.linuxbrew/bin/brew shellenv)"' >> /root/.bashrc eval "$(/home/linuxbrew/.linuxbrew/bin/brew shellenv)"因为是直接在root账户下安装的,所以环境变量也都设置的root账户下。
同时它还提醒安装gcc,照办:
brew install gcc配置一下清华加速镜像
export HOMEBREW_BREW_GIT_REMOTE="https://mirrors.ustc.edu.cn/brew.git" export HOMEBREW_CORE_GIT_REMOTE="https://mirrors.ustc.edu.cn/homebrew-core.git" export HOMEBREW_BOTTLE_DOMAIN="https://mirrors.ustc.edu.cn/homebrew-bottles" 安装完成,测试一下,安装llama.cpp
安装llama.cpp
先用brew search查看一下 llama相关的软件包
brew search llama ==> Formulae gollama llama.cpp ollama lla llm直接brew安装llama.cpp
brew install llama.cpp配置llama.cpp加速镜像
如果速度慢,就加上Huggingface的加速镜像
export HF_ENDPOINT=https://hf-mirror.com用llama.cpp启动文心ERNIE模型
就用这个文心ERNIE明星模型ERNIE-4.5-21B-A3B-Thinking ,当然是GGUF格式的:ERNIE-4.5-21B-A3B-Thinking-Q4_K_M-GGUF
llama-cli --hf-repo enacimie/ERNIE-4.5-21B-A3B-Thinking-Q4_K_M-GGUF --hf-file ernie-4.5-21b-a3b-thinking-q4_k_m.gguf -p "The meaning to life and the universe is" 如果下载模型速度慢,就加上Huggingface的加速镜像
export HF_ENDPOINT=https://hf-mirror.com启动了,但是因为只用了异构计算架构的cpu,么有用到dcu,所以速度非常慢,有多慢呢,简直比13年前的cpu慢
<|im_start|>user The meaning to life and the universe is <|im_start|>assistant We are going to explore the meaning of life and the universe in the context of human existence. The Meaning of Life: Philosophical Perspectives: - Existentialism: Emphasizes individual freedom and responsibility. The meaning of life is what each person chooses to create. - Eudaimonism: Focuses on flourishing (eudaimonia) through virtues and realizing one's potential. - Religious/Spiritual Views: Many religions propose that life's meaning comes from serving a higher power or fulfilling a divine plan. The Meaning of the Universe: Cosmological View: - The universe is vast and indifferent to human concerns. - Big Bang Theory: The universe began 13.8 billion years ago and has been expanding ever since. - Steady State Theory: The universe is eternally constant, but this has been largely discredited. - Multiverse Theory: Our universe is one of many, with each having different physical laws. Connecting Life and总结
这次主要是实践在Linux系统安装brew,并通过brew来安装llama.cpp,进而启动文心大模型。
总体实践成功过!