chatglm3-6b 模型部署+结合flask进行调用_chaglm3 接口调用集成

模型下载
git lfs install
git clone https://www.modelscope.cn/ZhipuAI/chatglm3-6b.git

from flask import  Flask,jsonify,request
from transformers import AutoTokenizer, AutoModel
app = Flask(__name__)
tokenizer = AutoTokenizer.from_pretrained("E:/yi\chatglm3-6b", trust_remote_code=True)
model = AutoModel.from_pretrained("E:/yi\chatglm3-6b", trust_remote_code=True).half().cuda()
model = model.eval()
@app.route('/goodsApi',methods=['get'])
def transaction():
    item ={}
 
    title = request.args.get("title")
    title1 = request.args.get("title1")
    
    response, history = model.chat(tokenizer,title, history=[])
    response, history = model.chat(tokenizer, title+'和'+title1+'  这两句话的相似度是多少', history=[])
 
    item['data'] =response
 
    return item,200
 
 
if __name__ == '__main__':
        app.run(host='0.0.0.0', port=5000)

最后访问地址因为是开的5000端口所以本地访问5000端口

http://127.0.0.1:5000/goodsApi?title=hello&title1=hello123