[e 0702 10:05:07.247670 00 mem_info.cc:101] appear time → node cnt: {2:494, }
Traceback (most recent call last):
File “/Users/zhou/Documents/JittorLLMs/JittorLLMs/cli_demo.py”, line 9, in
model.chat()
File “/Users/zhou/Documents/JittorLLMs/JittorLLMs/models/chatglm/init.py”, line 36, in chat
for response, history in self.model.stream_chat(self.tokenizer, text, history=history):
File “/Users/zhou/.cache/huggingface/modules/transformers_modules/local/modeling_chatglm.py”, line 1259, in stream_chat
for outputs in self.stream_generate(**input_ids, **gen_kwargs):
File “/Users/zhou/.cache/huggingface/modules/transformers_modules/local/modeling_chatglm.py”, line 1334, in stream_generate
model_inputs = self.prepare_inputs_for_generation(input_ids, **model_kwargs)
File “/Users/zhou/.cache/huggingface/modules/transformers_modules/local/modeling_chatglm.py”, line 1083, in prepare_inputs_for_generation
mask_token = MASK if MASK in input_ids else gMASK
File “/usr/local/lib/python3.9/site-packages/jittor/misc.py”, line 132, in contains
return bool((x == key).any())
File “/usr/local/lib/python3.9/site-packages/jittor/init.py”, line 2013, in to_bool
return ori_bool(v.item())
RuntimeError: [f 0702 10:05:07.247871 00 executor.cc:682]
Execute fused operator(197/257) failed.
[JIT Source]: /Users/zhou/.cache/jittor/jt1.3.7/clang14.0.3/py3.9.14/macOS-13.4.1-xx8e/IntelRCoreTMi5x81/default/jit/__opkey0_unary__Tx_float16__Ty_float32__OP_cast__JIT_1__JIT_cpu_1__graph_010000___var_info___hash_fb103b06255339ba_op.cc
[OP TYPE]: fused_op:( unary.cast,)
[Input]: float16[4096,16384,],
[Output]: float32[4096,16384,]transformer.layers.21.mlp.dense_4h_to_h.weight,
[Async Backtrace]: —
/Users/zhou/Documents/JittorLLMs/JittorLLMs/cli_demo.py:8 <>
/Users/zhou/Documents/JittorLLMs/JittorLLMs/models/init.py:46 <get_model>
/Users/zhou/Documents/JittorLLMs/JittorLLMs/models/chatglm/init.py:48 <get_model>
/Users/zhou/Documents/JittorLLMs/JittorLLMs/models/chatglm/init.py:26 <init>
/usr/local/lib/python3.9/site-packages/jittor/init.py:1730
[Reason]: [f 0702 10:05:07.243268 00 swap.cc:63] Check failed: res==1 failed to write swap file /Users/zhou/.cache/jittor/jt1.3.7/clang14.0.3/py3.9.14/macOS-13.4.1-xx8e/IntelRCoreTMi5x81/default/tmp/32714-11943.bin 0 268435456 Var(11943:1:1:1:i0:o0:s1:n0,float32,transformer.layers.19.mlp.dense_4h_to_h.weight,7f7dedf00000)[4096,16384,]{/Users/zhou/Documents/JittorLLMs/JittorLLMs/cli_demo.py:8() → /Users/zhou/Documents/JittorLLMs/JittorLLMs/models/init.py:46(get_model) → /Users/zhou/Documents/JittorLLMs/JittorLLMs/models/chatglm/init.py:48(get_model) → /Users/zhou/Documents/JittorLLMs/JittorLLMs/models/chatglm/init.py:26(init) → /usr/local/lib/python3.9/site-packages/jittor/init.py:1730(float32) → }