00000080:00200080:1.0F:1715206676.676539:0:3487:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=8950f0 00800000:00000080:1.0:1715206676.676555:0:3487:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b6358060 uarg=0000000000000000 00000002:00000080:1.0:1715206676.676577:0:3487:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b6358060 uarg=0000000000000000 00000100:00100000:1.0:1715206676.676611:0:3487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967a300 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504930944:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1715206676.676668:0:3487:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd0c0 going to sleep for 143 seconds 00000100:00100000:0.0F:1715206676.678099:0:3487:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967a300 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504930944:192.168.201.123@tcp:60:lhsmtool_posix.0 00000002:00000080:0.0:1715206676.678117:0:3487:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b6358060 uarg=0000000000000000 00000100:00100000:0.0:1715206676.678148:0:3487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4700 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504931008:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1715206676.678188:0:3487:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e1e5180 going to sleep for 143 seconds 00000100:00100000:1.0:1715206676.678832:0:3487:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4700 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504931008:192.168.201.123@tcp:60:lhsmtool_posix.0 00000080:00200008:1.0:1715206676.678862:0:3487:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:1.0:1715206676.678889:0:3487:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff88012a412d80 x1798523504930496/t4294967386(4294967386) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206823 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:1.0:1715206676.678914:0:3487:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1715206676.678918:0:3487:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9679c00 x1798523504931136/t0(0) o35->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715206676.678927:0:3487:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9679c00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504931136:192.168.201.123@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1715206676.678960:0:3487:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd000 going to sleep for 11 seconds 00000100:00100000:2.0F:1715206676.679864:0:3487:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9679c00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:3487:1798523504931136:192.168.201.123@tcp:35:lhsmtool_posix.0 00000002:00100000:2.0:1715206676.679895:0:3487:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012a412d80 x1798523504930496/t4294967386(4294967386) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206823 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:2.0:1715206676.679921:0:3487:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200008:2.0:1715206676.681778:0:3487:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00010000:00010000:1.0:1715206677.072786:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1715206678.024734:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715206678.024742:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715206678.024751:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715206678.024755:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715206678.024766:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715206678.024769:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:0.0:1715206678.024805:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2001:1798523504931264:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206678.024843:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504931200:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206678.024884:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523504931392:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206678.024894:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504931328:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206678.024914:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504931456:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206678.026647:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2001:1798523504931264:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206678.026669:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523504931392:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206678.026686:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504931200:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206678.026703:0:2000:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a9618000: committing for last_committed 4294967387 gen 1 00000100:00100000:0.0:1715206678.026709:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504931328:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206678.026719:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504931456:192.168.201.123@tcp:400:kworker.0 00010000:00010000:1.0:1715206678.074799:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715206678.854753:0:4281:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 18:17:58 (1715206678) 00000080:00200008:3.0F:1715206678.931616:0:4325:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206678.931628:0:4325:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715206678.931645:0:4325:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206678.931659:0:4325:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206678.931671:0:4325:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206678.931681:0:4325:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715206678.931684:0:4325:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:3.0:1715206678.931690:0:4325:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a92b3cc8 00010000:00010000:3.0:1715206678.931693:0:4325:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206678.931700:0:4325:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1715206678.932072:0:4325:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206678.932076:0:4325:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715206678.932099:0:4325:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206678.932140:0:4325:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932148:0:4325:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932156:0:4325:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4325 initiator: MDT0 00000100:00100000:3.0:1715206678.932182:0:4325:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369c00 going to sleep for 0 seconds 00000100:00100000:3.0:1715206678.932192:0:4325:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a413100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:04532c2b-e5e9-420d-abb0-4480aab1e378:4325:1798523504931520:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715206678.932206:0:4325:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932212:0:4325:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932217:0:4325:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932222:0:4325:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932229:0:4325:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932234:0:4325:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa54a880 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715206678.932237:0:4325:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932242:0:4325:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932248:0:4325:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932253:0:4325:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206678.932258:0:4325:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4325 initiator: MDT0 00010000:00010000:3.0:1715206678.932263:0:4325:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556fd71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4325 initiator: MDT0 00000080:00020000:3.0:1715206678.932281:0:4325:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715206678.932296:0:4325:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206678.932304:0:4325:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715206678.932311:0:4325:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206678.932317:0:4325:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206678.932325:0:4325:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206678.932332:0:4325:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715206678.932335:0:4325:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:3.0:1715206678.932338:0:4325:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a92b3cc8 00010000:00010000:3.0:1715206678.932341:0:4325:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206678.932347:0:4325:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206678.932410:0:4325:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715206678.932418:0:4325:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206678.932424:0:4325:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206678.932431:0:4325:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206678.932438:0:4325:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715206678.932441:0:4325:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:3.0:1715206678.932444:0:4325:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a92b3b80 00010000:00010000:3.0:1715206678.932447:0:4325:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206678.932457:0:4325:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206678.932466:0:4325:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715206678.932473:0:4325:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:1.0:1715206678.932978:0:4326:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715206678.932988:0:4326:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206678.932993:0:4326:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206678.933000:0:4326:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206678.933007:0:4326:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715206678.933008:0:4326:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:1.0:1715206678.933011:0:4326:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800b3f13b80 00010000:00010000:1.0:1715206678.933013:0:4326:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206678.933018:0:4326:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715206678.933033:0:4326:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715206678.933036:0:4326:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:1.0:1715206678.933049:0:4326:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715206678.933052:0:4326:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206678.933055:0:4326:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206678.933059:0:4326:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206678.933063:0:4326:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715206678.933065:0:4326:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:1.0:1715206678.933075:0:4326:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800b3f13bb0 00010000:00010000:1.0:1715206678.933077:0:4326:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206678.933080:0:4326:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715206678.933101:0:4326:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715206678.933104:0:4326:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:1.0:1715206678.933107:0:4326:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff880136f410c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715206678.933113:0:4326:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), file ffff8800b6dc7800, open_flags 8000, mode 0 opened 0 00000080:00200000:1.0:1715206678.933117:0:4326:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), intent=open 00000002:00010000:1.0:1715206678.933123:0:4326:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:1.0:1715206678.933144:0:4326:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 4326 initiator: MDT0 00010000:00010000:1.0:1715206678.933147:0:4326:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 4326 initiator: MDT0 00000020:00100000:1.0:1715206678.933153:0:4326:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1715206678.933159:0:4326:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a967b100 x1798523504931648/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1715206678.933165:0:4326:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 4326 initiator: MDT0 00000100:00100000:1.0:1715206678.933173:0:4326:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967b100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:4326:1798523504931648:192.168.201.123@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1715206678.933280:0:4326:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd240 going to sleep for 143 seconds 00000100:00100000:1.0:1715206678.934726:0:4326:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967b100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:4326:1798523504931648:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715206678.934736:0:4326:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 4326 initiator: MDT0 00010000:00010000:1.0:1715206678.934747:0:4326:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 4326 initiator: MDT0 00010000:00010000:1.0:1715206678.934751:0:4326:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 4326 initiator: MDT0 00010000:00010000:1.0:1715206678.934756:0:4326:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 4326 initiator: MDT0 00010000:00010000:1.0:1715206678.934761:0:4326:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 4326 initiator: MDT0 00010000:00010000:1.0:1715206678.934766:0:4326:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa669d40 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206678.934769:0:4326:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 4326 initiator: MDT0 00010000:00010000:1.0:1715206678.934774:0:4326:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 4326 initiator: MDT0 00010000:00010000:1.0:1715206678.934779:0:4326:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 4326 initiator: MDT0 00010000:00010000:1.0:1715206678.934784:0:4326:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206678.934787:0:4326:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 4326 initiator: MDT0 00010000:00010000:1.0:1715206678.934792:0:4326:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa669d40/0x7561918bd556fd78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 4326 initiator: MDT0 00000002:00100000:1.0:1715206678.934813:0:4326:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800a967b100 x1798523504931648/t4294967388(4294967388) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206826 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:1.0:1715206678.934824:0:4326:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a967b100 x1798523504931648/t4294967388(4294967388) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206826 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:1.0:1715206678.934848:0:4326:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 4096 00000080:00200000:1.0:1715206678.934850:0:4326:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b02788c8): rc = 0 00000080:00010000:1.0:1715206678.934853:0:4326:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b02788c8) for lock 0x0 00000080:00200008:1.0:1715206678.934863:0:4326:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:1.0:1715206678.934872:0:4326:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a967b100 x1798523504931648/t4294967388(4294967388) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206826 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:1.0:1715206678.934901:0:4326:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b02788c8), inode mode 4040 mask 44 00000080:00200080:1.0:1715206678.934934:0:4326:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=1b6f0f0 00800000:00000080:1.0:1715206678.934940:0:4326:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800abd4be80 uarg=0000000000000000 00000002:00000080:1.0:1715206678.934946:0:4326:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800abd4be80 uarg=0000000000000000 00000100:00100000:1.0:1715206678.934960:0:4326:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:4326:1798523504931712:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1715206678.934994:0:4326:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd840 going to sleep for 143 seconds 00000100:00100000:2.0:1715206678.935671:0:4326:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:4326:1798523504931712:192.168.201.123@tcp:59:lhsmtool_posix.0 00000002:00000080:2.0:1715206678.935682:0:4326:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800abd4be80 uarg=0000000000000000 00000100:00100000:2.0:1715206678.935697:0:4326:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:4326:1798523504931776:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715206678.935719:0:4326:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fcc0 going to sleep for 143 seconds 00000100:00100000:2.0:1715206678.936268:0:4326:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:4326:1798523504931776:192.168.201.123@tcp:59:lhsmtool_posix.0 00000080:00200000:1.0:1715206678.938863:0:4327:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206678.938872:0:4327:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206678.938890:0:4327:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938895:0:4327:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938900:0:4327:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4327 initiator: MDT0 00000100:00100000:1.0:1715206678.938906:0:4327:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7ddb40 going to sleep for 0 seconds 00000100:00100000:1.0:1715206678.938910:0:4327:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967bb80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:4327:1798523504931840:192.168.201.123@tcp:101:lfs.0 00010000:00010000:1.0:1715206678.938915:0:4327:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938925:0:4327:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938929:0:4327:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938932:0:4327:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938935:0:4327:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938938:0:4327:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa669200 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206678.938940:0:4327:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938943:0:4327:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938946:0:4327:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938949:0:4327:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206678.938951:0:4327:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938954:0:4327:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669200/0x7561918bd556fd7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4327 initiator: MDT0 00000080:00020000:1.0:1715206678.938964:0:4327:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715206678.938977:0:4327:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206678.938982:0:4327:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206678.938995:0:4327:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.938999:0:4327:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939002:0:4327:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4327 initiator: MDT0 00000100:00100000:1.0:1715206678.939007:0:4327:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7ddb40 going to sleep for 0 seconds 00000100:00100000:1.0:1715206678.939010:0:4327:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967bb80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:4327:1798523504931904:192.168.201.123@tcp:101:lfs.0 00010000:00010000:1.0:1715206678.939013:0:4327:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939017:0:4327:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939020:0:4327:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939022:0:4327:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939025:0:4327:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939028:0:4327:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa668d80 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206678.939030:0:4327:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939032:0:4327:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939035:0:4327:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939041:0:4327:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206678.939043:0:4327:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939046:0:4327:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668d80/0x7561918bd556fd86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4327 initiator: MDT0 00000080:00020000:1.0:1715206678.939054:0:4327:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715206678.939063:0:4327:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715206678.939065:0:4327:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206678.939069:0:4327:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206678.939077:0:4327:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939081:0:4327:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939099:0:4327:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4327 initiator: MDT0 00000100:00100000:1.0:1715206678.939104:0:4327:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7ddb40 going to sleep for 0 seconds 00000100:00100000:1.0:1715206678.939108:0:4327:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967bb80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:4327:1798523504931968:192.168.201.123@tcp:101:lfs.0 00010000:00010000:1.0:1715206678.939112:0:4327:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939115:0:4327:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939119:0:4327:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939127:0:4327:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939131:0:4327:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939134:0:4327:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa668900 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206678.939135:0:4327:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939138:0:4327:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939141:0:4327:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939144:0:4327:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206678.939146:0:4327:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4327 initiator: MDT0 00010000:00010000:1.0:1715206678.939149:0:4327:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668900/0x7561918bd556fd8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4327 initiator: MDT0 00000080:00020000:1.0:1715206678.939157:0:4327:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715206679.019964:0:4364:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206679.019986:0:4364:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206679.020029:0:4364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020037:0:4364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020044:0:4364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4364 initiator: MDT0 00000100:00100000:1.0:1715206679.020060:0:4364:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dde40 going to sleep for 0 seconds 00000100:00100000:1.0:1715206679.020069:0:4364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967bb80 pname:cluuid:pid:xid:nid:opc:job mkdir:04532c2b-e5e9-420d-abb0-4480aab1e378:4364:1798523504932032:192.168.201.123@tcp:101:mkdir.0 00010000:00010000:1.0:1715206679.020077:0:4364:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020098:0:4364:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020103:0:4364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020108:0:4364:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020112:0:4364:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020116:0:4364:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa6698c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206679.020119:0:4364:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020123:0:4364:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020128:0:4364:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020131:0:4364:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206679.020135:0:4364:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4364 initiator: MDT0 00010000:00010000:1.0:1715206679.020139:0:4364:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd556fd94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 4364 initiator: MDT0 00000080:00020000:1.0:1715206679.020160:0:4364:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:3.0:1715206679.076677:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715206679.428230:0:4498:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12b: @@@@@@ FAIL: cannot create directory '/mnt/lustre/d12b.sanity-hsm' Debug log: 239 lines, 239 kept, 0 dropped, 0 bad.