用户输入:hello
[e 0420 16:49:48.687894 04 mem_info.cc:101] appear time → node cnt: {1:888, }
Traceback (most recent call last):
File “/home/zhw/JittorLLMs/cli_demo.py”, line 9, in
model.chat()
File “/home/zhw/JittorLLMs/models/chatglm/init.py”, line 36, in chat
for response, history in self.model.stream_chat(self.tokenizer, text, history=history):
File “/home/zhw/.cache/huggingface/modules/transformers_modules/local/modeling_chatglm.py”, line 1259, in stream_chat
for outputs in self.stream_generate(**input_ids, **gen_kwargs):
File “/home/zhw/.cache/huggingface/modules/transformers_modules/local/modeling_chatglm.py”, line 1334, in stream_generate
model_inputs = self.prepare_inputs_for_generation(input_ids, **model_kwargs)
File “/home/zhw/.cache/huggingface/modules/transformers_modules/local/modeling_chatglm.py”, line 1083, in prepare_inputs_for_generation
mask_token = MASK if MASK in input_ids else gMASK
File “/home/zhw/.local/lib/python3.10/site-packages/jittor/misc.py”, line 132, in contains
return bool((x == key).any())
File “/home/zhw/.local/lib/python3.10/site-packages/jittor/init.py”, line 2013, in to_bool
return ori_bool(v.item())
RuntimeError: [f 0420 16:49:48.687974 04 executor.cc:682]
Execute fused operator(0/257) failed.
[JIT Source]: /home/zhw/.cache/jittor/jt1.3.7/g++12.2.0/py3.10.7/Linux-5.19.0-4x4d/11thGenIntelRCx42/default/jit/__opkey0_unary__Tx_float16__Ty_float32__OP_cast__JIT_1__JIT_cpu_1__graph_010000___var_info___hash_bc5c187fee6b4175_op.cc
[OP TYPE]: fused_op:( unary.cast,)
[Input]: float16[150528,4096,],
[Output]: float32[150528,4096,]transformer.word_embeddings.weight,
[Async Backtrace]: —
/home/zhw/JittorLLMs/cli_demo.py:8 <>
/home/zhw/JittorLLMs/models/init.py:46 <get_model>
/home/zhw/JittorLLMs/models/chatglm/init.py:48 <get_model>
/home/zhw/JittorLLMs/models/chatglm/init.py:26 <init>
/home/zhw/.local/lib/python3.10/site-packages/jittor/init.py:1730
[Reason]: [f 0420 16:49:48.682944 04 swap.cc:63] Check failed: res==1 failed to write swap file /home/zhw/.cache/jittor/jt1.3.7/g++12.2.0/py3.10.7/Linux-5.19.0-4x4d/11thGenIntelRCx42/default/tmp/4428-11492.bin 0 1233125376 Var(11492:1:1:1:i0:o0:s1:n0,float16,7f3ca4797040)[616562688,]{/home/zhw/JittorLLMs/cli_demo.py:8() → /home/zhw/JittorLLMs/models/init.py:46(get_model) → /home/zhw/JittorLLMs/models/chatglm/init.py:48(get_model) → /home/zhw/JittorLLMs/models/chatglm/init.py:22(init) → /home/zhw/.local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:459(from_pretrained) → /home/zhw/.local/lib/python3.10/site-packages/transformers/modeling_utils.py:2478(from_pretrained) → /home/zhw/.local/lib/python3.10/site-packages/transformers/modeling_utils.py:2780(_load_pretrained_model) → /home/zhw/.local/lib/python3.10/site-packages/transformers/modeling_utils.py:415(load_state_dict) → /home/zhw/.local/lib/python3.10/site-packages/jtorch/init.py:228(load) → /home/zhw/.local/lib/python3.10/site-packages/jittor/init.py:1124(load) → /home/zhw/.local/lib/python3.10/site-packages/jittor/init.py:98(safeunpickle) → /home/zhw/.local/lib/python3.10/site-packages/jittor_utils/load_pytorch.py:221(load_pytorch) → /home/zhw/.local/lib/python3.10/site-packages/jittor_utils/load_pytorch.py:44(persistent_load) → /home/zhw/.local/lib/python3.10/site-packages/jittor_utils/load_pytorch.py:21(load_tensor) → }
zhw@zhw:~/JittorLLMs$ ^C
我的报错和你一样，你的问题解决了吗？要是解决了是怎么解决的？