遥感图像旋转目标检测测试错误

命令: python tools/run_net.py --config-file alg_configs/s2anet_r50_fpn_1x_fair1m_rotate_balance_ms.py --task test

但是训练没有问题:

输出:
[i 0915 13:54:53.403907 48 tracer.cc:15] Load gdb_path: /usr/bin/gdb
[i 0915 13:54:53.414462 48 compiler.py:955] Jittor(1.3.5.13) src: /home/dell/miniconda3/envs/jittor/lib/python3.7/site-packages/jittor
[i 0915 13:54:53.421229 48 compiler.py:956] g++ at /usr/local/cuda-11.1/bin/g++(8.4.0)
[i 0915 13:54:53.421420 48 compiler.py:957] cache_path: /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default
[i 0915 13:54:53.437843 48 install_cuda.py:88] cuda_driver_version: [11, 4]
[i 0915 13:54:53.438459 48 install_cuda.py:76] restart /home/dell/miniconda3/envs/jittor/bin/python [‘tools/run_net.py’, ‘–config-file’, ‘alg_configs/s2anet_r50_fpn_1x_fair1m_rotate_balance_ms.py’, ‘–task’, ‘test’]
[i 0915 13:54:53.584858 68 tracer.cc:15] Load gdb_path: /usr/bin/gdb
[i 0915 13:54:53.595295 68 compiler.py:955] Jittor(1.3.5.13) src: /home/dell/miniconda3/envs/jittor/lib/python3.7/site-packages/jittor
[i 0915 13:54:53.602103 68 compiler.py:956] g++ at /usr/local/cuda-11.1/bin/g++(8.4.0)
[i 0915 13:54:53.602190 68 compiler.py:957] cache_path: /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default
[i 0915 13:54:53.619362 68 install_cuda.py:88] cuda_driver_version: [11, 4]
[i 0915 13:54:53.619810 68 install_cuda.py:76] restart /home/dell/miniconda3/envs/jittor/bin/python [‘tools/run_net.py’, ‘–config-file’, ‘alg_configs/s2anet_r50_fpn_1x_fair1m_rotate_balance_ms.py’, ‘–task’, ‘test’]
[i 0915 13:54:53.763021 04 tracer.cc:15] Load gdb_path: /usr/bin/gdb
[i 0915 13:54:53.773583 04 compiler.py:955] Jittor(1.3.5.13) src: /home/dell/miniconda3/envs/jittor/lib/python3.7/site-packages/jittor
[i 0915 13:54:53.779938 04 compiler.py:956] g++ at /usr/local/cuda-11.1/bin/g++(8.4.0)
[i 0915 13:54:53.780018 04 compiler.py:957] cache_path: /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default
[i 0915 13:54:53.795738 04 install_cuda.py:88] cuda_driver_version: [11, 4]
[i 0915 13:54:53.803733 04 __init__.py:411] Found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/bin/nvcc(11.2.152) at /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/bin/nvcc.
[i 0915 13:54:53.887590 04 compiler.py:900] Found gdb(12.0.90) at /usr/bin/gdb
[i 0915 13:54:53.895157 04 __init__.py:411] Found addr2line(2.38) at /usr/bin/addr2line.
[i 0915 13:54:54.030890 04 compiler.py:1010] cuda key:cu11.2.152_sm_86
[i 0915 13:54:54.267685 04 __init__.py:227] Total mem: 62.50GB, using 16 procs for compiling.
[i 0915 13:54:54.451759 04 jit_compiler.cc:28] Load cc_path: /usr/local/cuda-11.1/bin/g++
[i 0915 13:54:54.572953 04 init.cc:62] Found cuda archs: [86,]
[i 0915 13:54:54.660663 04 __init__.py:411] Found mpicc(4.1.2) at /usr/bin/mpicc.
[i 0915 13:54:54.858709 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/include/cublas.h
[i 0915 13:54:54.874893 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/lib64/libcublas.so
[i 0915 13:54:54.875084 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/lib64/libcublasLt.so.11
[i 0915 13:54:55.810700 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/include/cudnn.h
[i 0915 13:54:55.857767 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/lib64/libcudnn.so.8
[i 0915 13:54:55.857953 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/lib64/libcudnn_ops_infer.so.8
[i 0915 13:54:55.864861 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/lib64/libcudnn_ops_train.so.8
[i 0915 13:54:55.865988 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/lib64/libcudnn_cnn_infer.so.8
[i 0915 13:54:55.894078 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/lib64/libcudnn_cnn_train.so.8
[i 0915 13:54:56.757473 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/include/curand.h
[i 0915 13:54:56.818715 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/lib64/libcurand.so
[i 0915 13:54:56.856094 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/include/cufft.h
[i 0915 13:54:56.919748 04 compile_extern.py:30] found /home/dell/.cache/jittor/jtcuda/cuda11.2_cudnn8_linux/lib64/libcufft.so
[i 0915 13:54:57.727227 04 cuda_flags.cc:32] CUDA enabled.
Loading config from: alg_configs/s2anet_r50_fpn_1x_fair1m_rotate_balance_ms.py
[w 0915 13:54:58.178661 04 init.py:1345] load parameter fc.weight failed …
[w 0915 13:54:58.178810 04 init.py:1345] load parameter fc.bias failed …
Thu Sep 15 13:54:59 2022 Loading model parameters from work_dirs/s2anet_r50_fpn_1x_fair1m_rotate_balance_ms/checkpoints/ckpt_12.pkl
Thu Sep 15 13:54:59 2022 Testing…
0%| | 0/423 [00:00<?, ?it/s]Caught segfault at address 0x7fa1f75fd800, thread_name: ‘’, flush log…
[i 0915 13:55:04.144828 04 tracer.cc:149] stack trace for pid= 888556
[New LWP 888687]
[New LWP 888688]
[New LWP 888689]
[New LWP 888692]
[New LWP 888694]
[New LWP 888695]
[New LWP 888696]
[New LWP 888785]
[New LWP 888792]
[New LWP 888793]
[New LWP 888794]
[New LWP 888795]
[New LWP 888796]
[New LWP 888797]
[New LWP 888798]
[New LWP 888799]
[New LWP 888800]
[New LWP 888801]
[New LWP 888802]
[New LWP 888803]
[New LWP 888804]
[New LWP 888805]
[New LWP 888806]
[New LWP 888807]
[New LWP 888808]
[New LWP 888821]
[Thread debugging using libthread_db enabled]
Using host libthread_db library “/lib/x86_64-linux-gnu/libthread_db.so.1”.
0x00007fa7e2adb49f in __GI___wait4 (pid=888883, stat_loc=0x0, options=0, usage=0x0) at …/sysdeps/unix/sysv/linux/wait4.c:30
30 …/sysdeps/unix/sysv/linux/wait4.c: 没有那个文件或目录.
[Current thread is 1 (Thread 0x7fa7e29ee740 (LWP 888556))]
#0 0x00007fa7e2adb49f in __GI___wait4 (pid=888883, stat_loc=0x0, options=0, usage=0x0) at …/sysdeps/unix/sysv/linux/wait4.c:30
#1 0x00007fa7e0ddfb27 in jittor::print_trace() () from /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default/jit_utils_core.cpython-37m-x86_64-linux-gnu.so
#2 0x00007fa7e0ddba45 in jittor::segfault_sigaction(int, siginfo_t*, void*) () from /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default/jit_utils_core.cpython-37m-x86_64-linux-gnu.so
#3
#4 0x00007fa6702860ff in jittor::CodeOp::jit_run() () from /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default/cu11.2.152_sm_86/jit/code__IN_SIZE_2__in0_dim_1__in0_type_int32__in1_dim_2__in1_type_float32__OUT_SIZE_1__out0____hash_cfd7a5b083309f02_op.so
#5 0x00007fa79bbff2ba in jittor::Profiler::record_and_run(void ()(jittor::Op), jittor::Op*, char const*) () from /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default/cu11.2.152_sm_86/jittor_core.cpython-37m-x86_64-linux-gnu.so
#6 0x00007fa79baa722f in jittor::Op::jit_run(jittor::JitKey&) () from /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default/cu11.2.152_sm_86/jittor_core.cpython-37m-x86_64-linux-gnu.so
#7 0x00007fa79bc070af in jittor::Executor::run_sync(std::vector<jittor::Var*, std::allocatorjittor::Var* >, bool, bool) () from /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default/cu11.2.152_sm_86/jittor_core.cpython-37m-x86_64-linux-gnu.so
#8 0x00007fa79baa4a30 in jittor::Op::init() () from /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default/cu11.2.152_sm_86/jittor_core.cpython-37m-x86_64-linux-gnu.so
#9 0x00007fa79ba0d7b8 in jittor::jit_op_maker::make_where(jittor::Var*, jittor::NanoString) () from /home/dell/.cache/jittor/jt1.3.5/g++8.4.0/py3.7.13/Linux-5.15.0-4x5e/IntelRXeonRW-2xe2/default/cu11.2.152_sm_86/jittor_core.cpython-37m-x86_64-linux-gnu.so
Undefined command: “py-bt”. Try “help”.
[Inferior 1 (process 888556) detached]
Segfault, exit
terminate called without an active exception
已放弃 (核心已转储)