开发者社区 > ModelScope模型即服务 > 正文

ModelScope中,get_vllm_engine不是这样import的么?

"2024-07-15 14:57:43,845 - modelscope - INFO - PyTorch version 2.0.1 Found.
2024-07-15 14:57:43,846 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer
2024-07-15 14:57:43,874 - modelscope - INFO - Loading done! Current index file version is 1.15.0, with md5 6ab0f7f3aeff04f1ed5e6c013213ed1f and a total number of 980 components indexed
[INFO:swift] Successfully registered /home/pai/lib/python3.9/site-packages/swift/llm/data/dataset_info.json
Traceback (most recent call last):
File ""/mnt/workspace/zihan/QBI_LLM_FT/src/scripts/simple_cli.py"", line 42, in
from swift.llm import (
ImportError: cannot import name 'get_vllm_engine' from 'swift.llm' (/home/pai/lib/python3.9/site-packages/swift/llm/init.py)
请问ModelScope中,get_vllm_engine不是这样import的么?"

展开
收起
小小爱吃香菜 2024-07-23 22:04:18 79 0
1 条回答
写回答
取消 提交回答
  • "您看下是不是装错了,
    pip uninstall swift
    pip install ms-swift -U 此回答整理自钉群“魔搭ModelScope开发者联盟群 ①”"

    2024-07-24 15:58:13
    赞同 展开评论 打赏

ModelScope旨在打造下一代开源的模型即服务共享平台,为泛AI开发者提供灵活、易用、低成本的一站式模型服务产品,让模型应用更简单!欢迎加入技术交流群:微信公众号:魔搭ModelScope社区,钉钉群号:44837352

相关电子书

更多
视觉AI能力的开放现状及ModelScope实战 立即下载
ModelScope助力语音AI模型创新与应用 立即下载
低代码开发师(初级)实战教程 立即下载