00000100:00080000:2.0F:1715207779.064710:0:17330:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1715207779.064725:0:17330:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED)
00000100:00100000:3.0F:1715207779.064732:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523505025280:192.168.201.123@tcp:400:kworker.0
00000100:00080000:2.0:1715207779.064738:0:17330:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1715207779.064742:0:17330:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED)
00000100:00080000:2.0:1715207779.064754:0:17330:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1715207779.064757:0:17330:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED)
00000100:00100000:2.0:1715207779.064785:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2003:1798523505025344:192.168.201.123@tcp:400:kworker.0
00000100:00100000:2.0:1715207779.064828:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505025472:192.168.201.123@tcp:400:kworker.0
00000100:00100000:3.0:1715207779.064839:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505025408:192.168.201.123@tcp:400:kworker.0
00000100:00100000:3.0:1715207779.064863:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505025536:192.168.201.123@tcp:400:kworker.0
00000100:00100000:3.0:1715207779.066619:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523505025280:192.168.201.123@tcp:400:kworker.0
00000100:00100000:3.0:1715207779.066647:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505025408:192.168.201.123@tcp:400:kworker.0
00000100:00100000:3.0:1715207779.066657:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505025536:192.168.201.123@tcp:400:kworker.0
00000100:00100000:2.0:1715207779.066717:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2003:1798523505025344:192.168.201.123@tcp:400:kworker.0
00000100:00100000:2.0:1715207779.066731:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505025472:192.168.201.123@tcp:400:kworker.0
00010000:00010000:0.0F:1715207779.274725:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000080:00200000:0.0:1715207779.371336:0:30973:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/
00000002:00010000:0.0:1715207779.371362:0:30973:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0
00010000:00010000:0.0:1715207779.371418:0:30973:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371429:0:30973:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371440:0:30973:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30973 initiator: MDT0
00000100:00100000:0.0:1715207779.371458:0:30973:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e1e5600 going to sleep for 0 seconds
00000100:00100000:0.0:1715207779.371469:0:30973:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a5500 pname:cluuid:pid:xid:nid:opc:job md5sum:04532c2b-e5e9-420d-abb0-4480aab1e378:30973:1798523505025600:192.168.201.123@tcp:101:md5sum.0
00010000:00010000:0.0:1715207779.371481:0:30973:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371488:0:30973:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371495:0:30973:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371502:0:30973:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371509:0:30973:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371515:0:30973:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa585b00 already unused, calling callback (ffffffffa1034e10)
00010000:00010000:0.0:1715207779.371520:0:30973:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371527:0:30973:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371540:0:30973:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371546:0:30973:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:0.0:1715207779.371552:0:30973:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 30973 initiator: MDT0
00010000:00010000:0.0:1715207779.371558:0:30973:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570192 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 30973 initiator: MDT0
00000080:00020000:0.0:1715207779.371605:0:30973:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
00000080:00200000:3.0:1715207779.377785:0:30975:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/
00000002:00010000:3.0:1715207779.377801:0:30975:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0
00010000:00010000:3.0:1715207779.377830:0:30975:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377840:0:30975:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377849:0:30975:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30975 initiator: MDT0
00000100:00100000:3.0:1715207779.377860:0:30975:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a90c89c0 going to sleep for 0 seconds
00000100:00100000:3.0:1715207779.377868:0:30975:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5c00 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:30975:1798523505025664:192.168.201.123@tcp:101:lfs.0
00010000:00010000:3.0:1715207779.377878:0:30975:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377884:0:30975:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377891:0:30975:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377907:0:30975:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377913:0:30975:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377919:0:30975:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa548fc0 already unused, calling callback (ffffffffa1034e10)
00010000:00010000:3.0:1715207779.377922:0:30975:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377928:0:30975:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377934:0:30975:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377939:0:30975:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:3.0:1715207779.377944:0:30975:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 30975 initiator: MDT0
00010000:00010000:3.0:1715207779.377949:0:30975:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa548fc0/0x7561918bd5570199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 30975 initiator: MDT0
00000080:00020000:3.0:1715207779.377967:0:30975:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
00000001:02000400:3.0:1715207779.797640:0:31108:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_14: @@@@@@ FAIL: could not archive file
00010000:00010000:3.0:1715207780.276757:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
Debug log: 59 lines, 59 kept, 0 dropped, 0 bad.