00010000:00010000:1.0F:1715210035.784755:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0F:1715210036.070087:0:16980:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:0.0:1715210036.070115:0:16980:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715210036.070171:0:16980:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070183:0:16980:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070193:0:16980:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16980 initiator: MDT0 00000100:00100000:0.0:1715210036.070211:0:16980:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421d80 going to sleep for 0 seconds 00000100:00100000:0.0:1715210036.070223:0:16980:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4a80 pname:cluuid:pid:xid:nid:opc:job stat:04532c2b-e5e9-420d-abb0-4480aab1e378:16980:1798523505210560:192.168.201.123@tcp:101:stat.0 00010000:00010000:0.0:1715210036.070234:0:16980:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070241:0:16980:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070248:0:16980:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070255:0:16980:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070262:0:16980:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070268:0:16980:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa585b00 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:0.0:1715210036.070272:0:16980:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070279:0:16980:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070297:0:16980:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070303:0:16980:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715210036.070308:0:16980:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 16980 initiator: MDT0 00010000:00010000:0.0:1715210036.070315:0:16980:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa585b00/0x7561918bd5570a7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 16980 initiator: MDT0 00000080:00020000:0.0:1715210036.070337:0:16980:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:0.0:1715210036.786796:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1715210037.144721:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715210037.144729:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715210037.144746:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715210037.144751:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715210037.144768:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715210037.144773:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:1.0:1715210037.144776:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2001:1798523505210624:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715210037.144815:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2000:1798523505210688:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210037.144864:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505210752:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715210037.144864:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523505210816:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210037.144899:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505210880:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210037.146828:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505210880:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715210037.146835:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2000:1798523505210688:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210037.146846:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2001:1798523505210624:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715210037.146850:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523505210816:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210037.146859:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505210752:192.168.201.123@tcp:400:kworker.0 00010000:00010000:3.0F:1715210037.788791:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715210038.790834:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715210039.792879:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715210040.794883:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715210041.796838:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1715210042.152752:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715210042.152760:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715210042.152769:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715210042.152772:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715210042.152785:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715210042.152788:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:0.0:1715210042.152832:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2001:1798523505211008:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210042.152859:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523505210944:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715210042.152910:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505211136:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210042.152920:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523505211072:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210042.152941:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523505211200:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715210042.154874:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2001:1798523505211008:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715210042.154899:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505211136:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210042.154902:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523505210944:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210042.154920:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523505211072:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210042.154930:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523505211200:192.168.201.123@tcp:400:kworker.0 00010000:00010000:0.0:1715210042.798837:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715210043.800841:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715210044.802848:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715210045.804836:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1715210046.084606:0:16999:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715210046.084633:0:16999:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715210046.084699:0:16999:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084731:0:16999:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084746:0:16999:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16999 initiator: MDT0 00000100:00100000:1.0:1715210046.084771:0:16999:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a90c80c0 going to sleep for 0 seconds 00000100:00100000:1.0:1715210046.084787:0:16999:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967bb80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:16999:1798523505211264:192.168.201.123@tcp:101:lfs.0 00010000:00010000:1.0:1715210046.084806:0:16999:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084818:0:16999:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084828:0:16999:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084837:0:16999:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084844:0:16999:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084850:0:16999:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa54bcc0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715210046.084855:0:16999:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084861:0:16999:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084868:0:16999:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084886:0:16999:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715210046.084892:0:16999:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 16999 initiator: MDT0 00010000:00010000:1.0:1715210046.084898:0:16999:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54bcc0/0x7561918bd5570a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 16999 initiator: MDT0 00000080:00020000:1.0:1715210046.084923:0:16999:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000001:02000400:3.0:1715210046.579773:0:17134:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_31b: @@@@@@ FAIL: /home/green/git/lustre-release/lustre/utils/lfs hsm_state /mnt/lustre/d31b.sanity-hsm/f31b.sanity-hsm failed (run as root) 00010000:00010000:3.0:1715210046.806726:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1715210047.160707:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715210047.160716:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:1.0:1715210047.160730:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2001:1798523505211328:192.168.201.123@tcp:400:kworker.0 00000100:00080000:0.0:1715210047.160730:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715210047.160735:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715210047.160752:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715210047.160756:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:0.0:1715210047.160794:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2000:1798523505211392:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210047.160827:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505211456:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715210047.160845:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523505211520:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210047.160854:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505211584:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210047.162656:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2001:1798523505211328:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210047.162690:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505211456:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715210047.162698:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2000:1798523505211392:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715210047.162705:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505211584:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715210047.162713:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523505211520:192.168.201.123@tcp:400:kworker.0 Debug log: 101 lines, 101 kept, 0 dropped, 0 bad.