赞
踩
代码
tokenizer = AutoTokenizer.from_pretrained("./baichuan-7B", trust_remote_code=True)
报错
- File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
- File "<frozen importlib._bootstrap>", line 991, in _find_and_load
- File "<frozen importlib._bootstrap>", line 961, in _find_and_load_unlocked
- File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
- File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
- File "<frozen importlib._bootstrap>", line 991, in _find_and_load
- File "<frozen importlib._bootstrap>", line 973, in _find_and_load_unlocked
- ModuleNotFoundError: No module named 'transformers_modules.baichuan-7B'
找了半天,一个方法是把transformers降到4.26.1,但是我代码中有用来量化的BitsAndBytesConfig库,最少也要4.31版本以上。最后终于找到了另一个方法,把模型路径中的-变成_就解决啦!!!
修改后
tokenizer = AutoTokenizer.from_pretrained("./baichuan_7B", trust_remote_code=True)
就可以运行了!!!
Copyright © 2003-2013 www.wpsshop.cn 版权所有,并保留所有权利。