[人工智能] ubuntu 22.04 本地构建的 Qwen-VL 图像识别大语言模型支持人工智能视觉

最编程 2024-04-11 13:07:38

...

下载源代码

yeqiang@yeqiang-MS-7B23:~/Downloads/src$ git clone https://gh-proxy.com/https://github.com/QwenLM/Qwen-VL
正克隆到 'Qwen-VL'...
remote: Enumerating objects: 584, done.
remote: Counting objects: 100% (305/305), done.
remote: Compressing objects: 100% (129/129), done.
remote: Total 584 (delta 273), reused 177 (delta 176), pack-reused 279
接收对象中: 100% (584/584), 26.69 MiB | 1.50 MiB/s, 完成.
处理 delta 中: 100% (334/334), 完成.

下载模型

yeqiang@yeqiang-MS-7B23:~/Downloads/ai$ git clone https://www.modelscope.cn/qwen/Qwen-VL-Chat.git
正克隆到 'Qwen-VL-Chat'...
remote: Enumerating objects: 205, done.
remote: Counting objects: 100% (48/48), done.
remote: Compressing objects: 100% (46/46), done.
remote: Total 205 (delta 17), reused 17 (delta 2), pack-reused 157
接收对象中: 100% (205/205), 15.59 MiB | 1.57 MiB/s, 完成.
处理 delta 中: 100% (82/82), 完成.
yeqiang@yeqiang-MS-7B23:~/Downloads/ai$ cd Qwen-VL-Chat/
yeqiang@yeqiang-MS-7B23:~/Downloads/ai/Qwen-VL-Chat$ ll
总用量 2776
-rw-rw-r-- 1 yeqiang yeqiang 1159 2024-04-07 14:10:32 config.json
-rw-rw-r-- 1 yeqiang yeqiang 73 2024-04-07 14:10:32 configuration.json
-rw-rw-r-- 1 yeqiang yeqiang 2087 2024-04-07 14:10:32 configuration_qwen.py
-rw-rw-r-- 1 yeqiang yeqiang 221 2024-04-07 14:10:32 generation_config.json
-rw-rw-r-- 1 yeqiang yeqiang 44654 2024-04-07 14:10:32 modeling_qwen.py
-rw-rw-r-- 1 yeqiang yeqiang 135 2024-04-07 14:10:32 pytorch_model-00001-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 135 2024-04-07 14:10:32 pytorch_model-00002-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 135 2024-04-07 14:10:32 pytorch_model-00003-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 135 2024-04-07 14:10:32 pytorch_model-00004-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 135 2024-04-07 14:10:32 pytorch_model-00005-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 135 2024-04-07 14:10:32 pytorch_model-00006-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 135 2024-04-07 14:10:32 pytorch_model-00007-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 135 2024-04-07 14:10:32 pytorch_model-00008-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 135 2024-04-07 14:10:32 pytorch_model-00009-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 135 2024-04-07 14:10:32 pytorch_model-00010-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 79941 2024-04-07 14:10:32 pytorch_model.bin.index.json
-rw-rw-r-- 1 yeqiang yeqiang 14873 2024-04-07 14:10:32 qwen_generation_utils.py
-rw-rw-r-- 1 yeqiang yeqiang 2561218 2024-04-07 14:10:32 qwen.tiktoken
-rw-rw-r-- 1 yeqiang yeqiang 25351 2024-04-07 14:10:32 README.md
-rw-rw-r-- 1 yeqiang yeqiang 133 2024-04-07 14:10:32 SimSun.ttf
-rw-rw-r-- 1 yeqiang yeqiang 21915 2024-04-07 14:10:32 tokenization_qwen.py
-rw-rw-r-- 1 yeqiang yeqiang 173 2024-04-07 14:10:32 tokenizer_config.json
-rw-rw-r-- 1 yeqiang yeqiang 14555 2024-04-07 14:10:32 visual.py

git拉取modescope.cn的镜像大小不正确，使用git lfs pull拉取大文件

sudo apt install git-lfs

在Qwen-VL-Chat目录下执行

git lfs install
git lfs pull

效果

yeqiang@yeqiang-MS-7B23:~/Downloads/ai/Qwen-VL-Chat$ ll -h
总用量 19G
-rw-rw-r-- 1 yeqiang yeqiang 1.2K 2024-04-07 14:10:32 config.json
-rw-rw-r-- 1 yeqiang yeqiang 73 2024-04-07 14:10:32 configuration.json
-rw-rw-r-- 1 yeqiang yeqiang 2.1K 2024-04-07 14:10:32 configuration_qwen.py
-rw-rw-r-- 1 yeqiang yeqiang 221 2024-04-07 14:10:32 generation_config.json
-rw-rw-r-- 1 yeqiang yeqiang 44K 2024-04-07 14:10:32 modeling_qwen.py
-rw-rw-r-- 1 yeqiang yeqiang 1.9G 2024-04-07 15:11:56 pytorch_model-00001-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 1.9G 2024-04-07 15:00:18 pytorch_model-00002-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 1.9G 2024-04-07 15:15:37 pytorch_model-00003-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 1.9G 2024-04-07 15:11:06 pytorch_model-00004-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 1.8G 2024-04-07 15:19:55 pytorch_model-00005-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 1.9G 2024-04-07 15:02:08 pytorch_model-00006-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 1.9G 2024-04-07 15:08:07 pytorch_model-00007-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 1.9G 2024-04-07 15:02:31 pytorch_model-00008-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 1.9G 2024-04-07 15:15:58 pytorch_model-00009-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 1.7G 2024-04-07 15:20:21 pytorch_model-00010-of-00010.bin
-rw-rw-r-- 1 yeqiang yeqiang 79K 2024-04-07 14:10:32 pytorch_model.bin.index.json
-rw-rw-r-- 1 yeqiang yeqiang 15K 2024-04-07 14:10:32 qwen_generation_utils.py
-rw-rw-r-- 1 yeqiang yeqiang 2.5M 2024-04-07 14:10:32 qwen.tiktoken
-rw-rw-r-- 1 yeqiang yeqiang 25K 2024-04-07 14:10:32 README.md
-rw-rw-r-- 1 yeqiang yeqiang 11M 2024-04-07 15:02:44 SimSun.ttf
-rw-rw-r-- 1 yeqiang yeqiang 22K 2024-04-07 14:10:32 tokenization_qwen.py
-rw-rw-r-- 1 yeqiang yeqiang 173 2024-04-07 14:10:32 tokenizer_config.json
-rw-rw-r-- 1 yeqiang yeqiang 15K 2024-04-07 14:10:32 visual.py
yeqiang@yeqiang-MS-7B23:~/Downloads/ai/Qwen-VL-Chat$ du -sh
37G .

检查python3版本

yeqiang@yeqiang-MS-7B23:~/Downloads/ai/Qwen-VL-Chat$ python3 -V
Python 3.10.12

创建venv环境

sudo apt install python3.10-venv
cd ~/Downloads/src/Qwen-VL/
python3 -m venv venv

加载env

yeqiang@yeqiang-MS-7B23:~/Downloads/src/Qwen-VL$ source venv/bin/activate
(venv) yeqiang@yeqiang-MS-7B23:~/Downloads/src/Qwen-VL$ python -V
Python 3.10.12
(venv) yeqiang@yeqiang-MS-7B23:~/Downloads/src/Qwen-VL$ pip -V
pip 22.0.2 from /home/yeqiang/Downloads/src/Qwen-VL/venv/lib/python3.10/site-packages/pip (python 3.10)

安装依赖

pip install -r requirements.txt

安装好的清单

(venv) yeqiang@yeqiang-MS-7B23:~/Downloads/src/Qwen-VL$ pip list
Package Version
----------------------------- -----------
absl-py 2.1.0
accelerate 0.29.1
certifi 2024.2.2
charset-normalizer 3.3.2
contourpy 1.2.1
cycler 0.12.1
einops 0.7.0
filelock 3.13.3
fonttools 4.51.0
fsspec 2024.3.1
grpcio 1.62.1
huggingface-hub 0.22.2
idna 3.6
Jinja2 3.1.3
kiwisolver 1.4.5
Markdown 3.6
MarkupSafe 2.1.5
matplotlib 3.8.4
mpmath 1.3.0
networkx 3.3
numpy 1.26.4
nvidia-cublas-cu12 12.1.3.1
nvidia-cuda-cupti-cu12 12.1.105
nvidia-cuda-nvrtc-cu12 12.1.105
nvidia-cuda-runtime-cu12 12.1.105
nvidia-cudnn-cu12 8.9.2.26
nvidia-cufft-cu12 11.0.2.54
nvidia-curand-cu12 10.3.2.106
nvidia-cusolver-cu12 11.4.5.107
nvidia-cusparse-cu12 12.1.0.106
nvidia-nccl-cu12 2.19.3
nvidia-nvjitlink-cu12 12.4.127
nvidia-nvtx-cu12 12.1.105
packaging 24.0
pillow 10.3.0
pip 22.0.2
protobuf 5.26.1
psutil 5.9.8
pyparsing 3.1.2
python-dateutil 2.9.0.post0
PyYAML 6.0.1
regex 2023.12.25
requests 2.31.0
safetensors 0.4.2
scipy 1.13.0
setuptools 59.6.0
six 1.16.0
sympy 1.12
tensorboard 2.16.2
tensorboard-data-server 0.7.2
tiktoken 0.6.0
tokenizers 0.13.3
torch 2.2.2
torchvision 0.17.2
tqdm 4.66.2
transformers 4.32.0
transformers-stream-generator 0.0.4
triton 2.2.0
typing_extensions 4.11.0
urllib3 2.2.1
Werkzeug 3.0.2

下载字体

(venv) yeqiang@yeqiang-MS-7B23:~/Downloads/src/Qwen-VL$ wget https://gh-proxy.com/https://github.com/StellarCN/scp_zh/raw/master/fonts/SimSun.ttf

给模型做个软连接

(venv) yeqiang@yeqiang-MS-7B23:~/Downloads/src/Qwen-VL$ ln -s ~/Downloads/ai/Qwen-VL-Chat .
(venv) yeqiang@yeqiang-MS-7B23:~/Downloads/src/Qwen-VL$ ll
总用量 10628
drwxrwxr-x 3 yeqiang yeqiang 4096 2024-04-07 13:58:32 assets
-rw-rw-r-- 1 yeqiang yeqiang 1029 2024-04-07 13:58:32 BUILD.md
-rw-rw-r-- 1 yeqiang yeqiang 1686 2024-04-07 13:58:32 Dockerfile.qwendemo
-rw-rw-r-- 1 yeqiang yeqiang 2209 2024-04-07 13:58:32 Dockerfile.qwenint4openai
-rw-rw-r-- 1 yeqiang yeqiang 1821 2024-04-07 13:58:32 Dockerfile.qwenopenai
drwxrwxr-x 5 yeqiang yeqiang 4096 2024-04-07 13:58:32 eval_mm
-rw-rw-r-- 1 yeqiang yeqiang 2540 2024-04-07 13:58:32 FAQ_ja.md
-rw-rw-r-- 1 yeqiang yeqiang 2235 2024-04-07 13:58:32 FAQ_ko.md
-rw-rw-r-- 1 yeqiang yeqiang 1809 2024-04-07 13:58:32 FAQ.md
-rw-rw-r-- 1 yeqiang yeqiang 2208 2024-04-07 13:58:32 FAQ_zh.md
drwxrwxr-x 2 yeqiang yeqiang 4096 2024-04-07 13:58:32 finetune
-rw-rw-r-- 1 yeqiang yeqiang 12479 2024-04-07 13:58:32 finetune.py
-rw-rw-r-- 1 yeqiang yeqiang 6903 2024-04-07 13:58:32 LICENSE
-rw-rw-r-- 1 yeqiang yeqiang 2703 2024-04-07 13:58:32 NOTICE
-rw-rw-r-- 1 yeqiang yeqiang 17688 2024-04-07 13:58:32 openai_api.py
lrwxrwxrwx 1 yeqiang yeqiang 39 2024-04-07 16:19:51 Qwen-VL-Chat -> /home/yeqiang/Downloads/ai/Qwen-VL-Chat
-rw-rw-r-- 1 yeqiang yeqiang 42732 2024-04-07 13:58:32 README_CN.md
-rw-rw-r-- 1 yeqiang yeqiang 43566 2024-04-07 13:58:32 README_JA.md
-rw-rw-r-- 1 yeqiang yeqiang 42118 2024-04-07 13:58:32 README_KO.md
-rw-rw-r-- 1 yeqiang yeqiang 45050 2024-04-07 13:58:32 README.md
-rw-rw-r-- 1 yeqiang yeqiang 46 2024-04-07 13:58:32 requirements_openai_api.txt
-rw-rw-r-- 1 yeqiang yeqiang 133 2024-04-07 13:58:32 requirements.txt
-rw-rw-r-- 1 yeqiang yeqiang 18 2024-04-07 13:58:32 requirements_web_demo.txt
-rw-rw-r-- 1 yeqiang yeqiang 10518768 2024-04-07 16:18:51 SimSun.ttf
drwxrwxr-x 2 yeqiang yeqiang 103 2024-04-07 13:58:32 touchstone
-rw-rw-r-- 1 yeqiang yeqiang 13203 2024-04-07 13:58:32 TUTORIAL_ja.md
-rw-rw-r-- 1 yeqiang yeqiang 14132 2024-04-07 13:58:32 TUTORIAL_ko.md
-rw-rw-r-- 1 yeqiang yeqiang 13391 2024-04-07 13:58:32 TUTORIAL.md
-rw-rw-r-- 1 yeqiang yeqiang 11423 2024-04-07 13:58:32 TUTORIAL_zh.md
drwxrwxr-x 6 yeqiang yeqiang 115 2024-04-07 16:15:50 venv
-rw-rw-r-- 1 yeqiang yeqiang 9695 2024-04-07 13:58:32 web_demo_mm.py

启动web界面

(venv) yeqiang@yeqiang-MS-7B23:~/Downloads/src/Qwen-VL$ python3 web_demo_mm.py -c ./Qwen-VL-Chat --server-name 0.0.0.0 --server-port 8000
Traceback (most recent call last):
File "/home/yeqiang/Downloads/src/Qwen-VL/web_demo_mm.py", line 12, in <module>
import gradio as gr
ModuleNotFoundError: No module named 'gradio'

漏了web的依赖

pip install -r requirements_web_demo.txt

2060带不动

参考资料

魔搭社区

通义千问

Qwen-VL/README_CN.md at master · QwenLM/Qwen-VL · GitHub

上一篇：前端 JavaScript 面试--功能整理

下一篇：相思难表，梦想无依，唯有归来。