00010000:00010000:0.0F:1715206675.516143:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:2.0F:1715206675.568004:0:4798:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=1e0d0f0 00800000:00000080:2.0:1715206675.568020:0:4798:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aa275e20 uarg=0000000000000000 00000002:00000080:2.0:1715206675.568027:0:4798:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aa275e20 uarg=0000000000000000 00000100:00100000:2.0:1715206675.568085:0:4798:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:4798:1798523503856000:192.168.202.138@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715206675.568138:0:4798:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391780 going to sleep for 145 seconds 00000100:00100000:2.0:1715206675.569078:0:4798:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:4798:1798523503856000:192.168.202.138@tcp:60:lhsmtool_posix.0 00000080:00200008:2.0:1715206675.569105:0:4798:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:2.0:1715206675.569126:0:4798:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff88012a616300 x1798523503855616/t4294967409(4294967409) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206824 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:2.0:1715206675.569140:0:4798:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1715206675.569143:0:4798:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b6325f80 x1798523503856128/t0(0) o35->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715206675.569151:0:4798:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:4798:1798523503856128:192.168.202.138@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715206675.569169:0:4798:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801373910c0 going to sleep for 11 seconds 00000100:00100000:3.0F:1715206675.569895:0:4798:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:4798:1798523503856128:192.168.202.138@tcp:35:lhsmtool_posix.0 00000002:00100000:3.0:1715206675.569911:0:4798:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012a616300 x1798523503855616/t4294967409(4294967409) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206824 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:3.0:1715206675.569933:0:4798:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200008:3.0:1715206675.571878:0:4798:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00010000:00010000:1.0F:1715206676.518123:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206677.520208:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1715206677.804116:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206677.804121:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715206677.804122:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206677.804124:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715206677.804133:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206677.804135:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715206677.804167:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503856256:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206677.804168:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503856192:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206677.804226:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503856320:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715206677.805391:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503856256:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206677.805392:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503856192:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206677.805401:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503856320:192.168.202.138@tcp:400:kworker.0 00010000:00010000:1.0:1715206678.522174:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715206679.011413:0:5693:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 18:17:58 (1715206678) 00000080:00200008:3.0:1715206679.076596:0:5736:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206679.076603:0:5736:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206679.076616:0:5736:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206679.076627:0:5736:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206679.076636:0:5736:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206679.076649:0:5736:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206679.076651:0:5736:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206679.076656:0:5736:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff880136b13cc8 00010000:00010000:3.0:1715206679.076658:0:5736:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206679.076663:0:5736:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1715206679.076910:0:5736:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206679.076912:0:5736:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715206679.076920:0:5736:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206679.076949:0:5736:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.076954:0:5736:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.076960:0:5736:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5736 initiator: MDT0 00000100:00100000:3.0:1715206679.076971:0:5736:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801303439c0 going to sleep for 0 seconds 00000100:00100000:3.0:1715206679.076978:0:5736:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9180 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:5736:1798523503856384:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715206679.076985:0:5736:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.076989:0:5736:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.076997:0:5736:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.077000:0:5736:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.077004:0:5736:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.077007:0:5736:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae761c0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715206679.077010:0:5736:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.077013:0:5736:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.077017:0:5736:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.077020:0:5736:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206679.077023:0:5736:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 5736 initiator: MDT0 00010000:00010000:3.0:1715206679.077026:0:5736:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae761c0/0xbbeffb005ec3dfa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 5736 initiator: MDT0 00000080:00020000:3.0:1715206679.077038:0:5736:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715206679.077063:0:5736:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206679.077065:0:5736:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206679.077070:0:5736:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206679.077074:0:5736:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206679.077081:0:5736:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206679.077086:0:5736:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206679.077087:0:5736:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206679.077089:0:5736:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff880136b13cc8 00010000:00010000:3.0:1715206679.077092:0:5736:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206679.077100:0:5736:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206679.077160:0:5736:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206679.077166:0:5736:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206679.077171:0:5736:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206679.077175:0:5736:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206679.077180:0:5736:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206679.077181:0:5736:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206679.077183:0:5736:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff880136b13b80 00010000:00010000:3.0:1715206679.077185:0:5736:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206679.077189:0:5736:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206679.077200:0:5736:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715206679.077204:0:5736:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:1.0:1715206679.077641:0:5737:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715206679.077650:0:5737:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206679.077655:0:5737:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206679.077662:0:5737:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206679.077667:0:5737:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715206679.077669:0:5737:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:1.0:1715206679.077671:0:5737:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff88013034fb80 00010000:00010000:1.0:1715206679.077673:0:5737:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206679.077677:0:5737:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715206679.077683:0:5737:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715206679.077685:0:5737:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:1.0:1715206679.077699:0:5737:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715206679.077701:0:5737:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206679.077704:0:5737:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206679.077708:0:5737:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206679.077712:0:5737:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715206679.077713:0:5737:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:1.0:1715206679.077718:0:5737:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff88013034fbb0 00010000:00010000:1.0:1715206679.077720:0:5737:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206679.077724:0:5737:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715206679.077728:0:5737:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715206679.077731:0:5737:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:1.0:1715206679.077733:0:5737:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff88012e4b90c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715206679.077738:0:5737:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), file ffff8800b6db6c00, open_flags 8000, mode 0 opened 0 00000080:00200000:1.0:1715206679.077742:0:5737:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), intent=open 00000002:00010000:1.0:1715206679.077748:0:5737:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:1.0:1715206679.077775:0:5737:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 5737 initiator: MDT0 00010000:00010000:1.0:1715206679.077780:0:5737:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 5737 initiator: MDT0 00000020:00100000:1.0:1715206679.077788:0:5737:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1715206679.077796:0:5737:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012a617480 x1798523503856512/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1715206679.077805:0:5737:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 5737 initiator: MDT0 00000100:00100000:1.0:1715206679.077817:0:5737:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a617480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:5737:1798523503856512:192.168.202.138@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1715206679.077913:0:5737:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5d15840 going to sleep for 145 seconds 00000100:00100000:1.0:1715206679.079244:0:5737:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800aa1c9800: committing for last_committed 4294967410 gen 1 00000100:00100000:1.0:1715206679.079251:0:5737:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff88012a617480 x1798523503856512/t4294967411(4294967411) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206829 ref 3 fl Rpc:RPQU/204/0 rc 0/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000100:00100000:1.0:1715206679.079266:0:5737:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a617480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:5737:1798523503856512:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715206679.079273:0:5737:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 5737 initiator: MDT0 00010000:00010000:1.0:1715206679.079278:0:5737:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 5737 initiator: MDT0 00010000:00010000:1.0:1715206679.079282:0:5737:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 5737 initiator: MDT0 00010000:00010000:1.0:1715206679.079285:0:5737:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 5737 initiator: MDT0 00010000:00010000:1.0:1715206679.079288:0:5737:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 5737 initiator: MDT0 00010000:00010000:1.0:1715206679.079291:0:5737:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bae880 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715206679.079293:0:5737:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 5737 initiator: MDT0 00010000:00010000:1.0:1715206679.079295:0:5737:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 5737 initiator: MDT0 00010000:00010000:1.0:1715206679.079298:0:5737:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 5737 initiator: MDT0 00010000:00010000:1.0:1715206679.079301:0:5737:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206679.079303:0:5737:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 5737 initiator: MDT0 00010000:00010000:1.0:1715206679.079306:0:5737:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bae880/0xbbeffb005ec3dfb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 5737 initiator: MDT0 00000002:00100000:1.0:1715206679.079319:0:5737:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012a617480 x1798523503856512/t4294967411(4294967411) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206829 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:1.0:1715206679.079326:0:5737:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a617480 x1798523503856512/t4294967411(4294967411) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206829 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:1.0:1715206679.079341:0:5737:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 10752 00000080:00200000:1.0:1715206679.079343:0:5737:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b08900c8): rc = 0 00000080:00010000:1.0:1715206679.079346:0:5737:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b08900c8) for lock 0x0 00000080:00200008:1.0:1715206679.079354:0:5737:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:1.0:1715206679.079361:0:5737:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a617480 x1798523503856512/t4294967411(4294967411) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206829 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:1.0:1715206679.079392:0:5737:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b08900c8), inode mode 4040 mask 44 00000080:00200080:1.0:1715206679.079454:0:5737:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=b930f0 00800000:00000080:1.0:1715206679.079462:0:5737:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800ac2d6180 uarg=0000000000000000 00000002:00000080:1.0:1715206679.079469:0:5737:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800ac2d6180 uarg=0000000000000000 00000100:00100000:1.0:1715206679.079484:0:5737:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a616300 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:5737:1798523503856576:192.168.202.138@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1715206679.079512:0:5737:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5d153c0 going to sleep for 145 seconds 00000100:00100000:0.0:1715206679.080117:0:5737:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a616300 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:5737:1798523503856576:192.168.202.138@tcp:59:lhsmtool_posix.0 00000080:00200000:1.0:1715206679.083850:0:5738:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715206679.083865:0:5738:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206679.083896:0:5738:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083904:0:5738:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083912:0:5738:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5738 initiator: MDT0 00000100:00100000:1.0:1715206679.083927:0:5738:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5d15540 going to sleep for 0 seconds 00000100:00100000:1.0:1715206679.083933:0:5738:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a615c00 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:5738:1798523503856640:192.168.202.138@tcp:101:lfs.0 00010000:00010000:1.0:1715206679.083940:0:5738:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083946:0:5738:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083952:0:5738:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083957:0:5738:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083962:0:5738:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083967:0:5738:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bac480 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715206679.083970:0:5738:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083975:0:5738:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083980:0:5738:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083986:0:5738:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206679.083989:0:5738:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.083994:0:5738:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bac480/0xbbeffb005ec3dfb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 5738 initiator: MDT0 00000080:00020000:1.0:1715206679.084015:0:5738:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715206679.084034:0:5738:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715206679.084061:0:5738:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206679.084078:0:5738:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084084:0:5738:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084090:0:5738:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5738 initiator: MDT0 00000100:00100000:1.0:1715206679.084098:0:5738:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5d15540 going to sleep for 0 seconds 00000100:00100000:1.0:1715206679.084103:0:5738:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a615c00 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:5738:1798523503856704:192.168.202.138@tcp:101:lfs.0 00010000:00010000:1.0:1715206679.084109:0:5738:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084114:0:5738:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084119:0:5738:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084124:0:5738:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084129:0:5738:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084133:0:5738:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bafcc0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715206679.084136:0:5738:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084145:0:5738:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084150:0:5738:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084154:0:5738:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206679.084157:0:5738:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084162:0:5738:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bafcc0/0xbbeffb005ec3dfbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 5738 initiator: MDT0 00000080:00020000:1.0:1715206679.084175:0:5738:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715206679.084189:0:5738:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715206679.084193:0:5738:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715206679.084199:0:5738:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206679.084213:0:5738:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084219:0:5738:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084225:0:5738:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5738 initiator: MDT0 00000100:00100000:1.0:1715206679.084232:0:5738:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5d15540 going to sleep for 0 seconds 00000100:00100000:1.0:1715206679.084237:0:5738:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a615c00 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:5738:1798523503856768:192.168.202.138@tcp:101:lfs.0 00010000:00010000:1.0:1715206679.084242:0:5738:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084247:0:5738:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084262:0:5738:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084267:0:5738:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084272:0:5738:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084277:0:5738:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136baf600 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715206679.084280:0:5738:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084284:0:5738:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084288:0:5738:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084292:0:5738:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206679.084295:0:5738:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 5738 initiator: MDT0 00010000:00010000:1.0:1715206679.084299:0:5738:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3dfc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 5738 initiator: MDT0 00000080:00020000:1.0:1715206679.084312:0:5738:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715206679.164458:0:5775:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715206679.164481:0:5775:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206679.164528:0:5775:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164546:0:5775:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164555:0:5775:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5775 initiator: MDT0 00000100:00100000:1.0:1715206679.164570:0:5775:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5d15600 going to sleep for 0 seconds 00000100:00100000:1.0:1715206679.164580:0:5775:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a615c00 pname:cluuid:pid:xid:nid:opc:job mkdir:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:5775:1798523503856832:192.168.202.138@tcp:101:mkdir.0 00010000:00010000:1.0:1715206679.164589:0:5775:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164595:0:5775:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164601:0:5775:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164606:0:5775:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164612:0:5775:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164617:0:5775:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bad8c0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715206679.164621:0:5775:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164626:0:5775:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164632:0:5775:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164651:0:5775:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206679.164656:0:5775:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 5775 initiator: MDT0 00010000:00010000:1.0:1715206679.164661:0:5775:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad8c0/0xbbeffb005ec3dfcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 5775 initiator: MDT0 00000080:00020000:1.0:1715206679.164679:0:5775:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000001:02000400:3.0:1715206679.507505:0:5907:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12b: @@@@@@ FAIL: cannot create directory '/mnt/lustre/d12b.sanity-hsm' 00010000:00010000:0.0:1715206679.524299:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 230 lines, 230 kept, 0 dropped, 0 bad.