00010000:00010000:3.0F:1715208021.758775:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:0.0F:1715208021.966788:0:8359:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=144b0f0 00800000:00000080:0.0:1715208021.966823:0:8359:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b5d8f460 uarg=0000000000000000 00000002:00000080:0.0:1715208021.966838:0:8359:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b5d8f460 uarg=0000000000000000 00000100:00100000:0.0:1715208021.966915:0:8359:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8359:1798523505050880:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1715208021.967048:0:8359:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e1e50c0 going to sleep for 11 seconds 00000100:00100000:2.0F:1715208021.968947:0:8359:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8359:1798523505050880:192.168.201.123@tcp:60:lhsmtool_posix.0 00000002:00000080:2.0:1715208021.968979:0:8359:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b5d8f460 uarg=0000000000000000 00000100:00100000:2.0:1715208021.969008:0:8359:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8359:1798523505050944:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715208021.969071:0:8359:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1715208021.970609:0:8359:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8359:1798523505050944:192.168.201.123@tcp:60:lhsmtool_posix.0 00000080:00200008:2.0:1715208021.970655:0:8359:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:2.0:1715208021.970700:0:8359:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff8800a9679500 x1798523505049408/t4294967447(4294967447) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208034 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:2.0:1715208021.970725:0:8359:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1715208021.970731:0:8359:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800abe2ea00 x1798523505051072/t0(0) o35->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715208021.970747:0:8359:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8359:1798523505051072:192.168.201.123@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715208021.970783:0:8359:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1715208021.972528:0:8359:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8359:1798523505051072:192.168.201.123@tcp:35:lhsmtool_posix.0 00000002:00100000:2.0:1715208021.972556:0:8359:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a9679500 x1798523505049408/t4294967447(4294967447) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208034 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:2.0:1715208021.972625:0:8359:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200008:2.0:1715208021.976323:0:8359:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00010000:00010000:3.0:1715208022.760864:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1715208023.762788:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1715208024.456751:0:17330:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715208024.456759:0:17330:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715208024.456770:0:17330:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715208024.456774:0:17330:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715208024.456789:0:17330:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715208024.456793:0:17330:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715208024.456802:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523505051136:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715208024.456822:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2003:1798523505051200:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715208024.456914:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505051328:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715208024.456925:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505051264:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715208024.456949:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505051392:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715208024.458811:0:2002:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a9618000: committing for last_committed 4294967451 gen 1 00000100:00100000:3.0:1715208024.458837:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2003:1798523505051200:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715208024.458839:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505051264:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715208024.458851:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505051328:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715208024.458857:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505051392:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715208024.458866:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523505051136:192.168.201.123@tcp:400:kworker.0 00010000:00010000:1.0:1715208024.764812:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715208024.778044:0:9592:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 24b: root can archive, release, and restore user files ========================================================== 18:40:24 (1715208024) 00000080:00200008:1.0:1715208024.892834:0:9635:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715208024.892847:0:9635:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208024.892878:0:9635:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208024.892901:0:9635:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.892919:0:9635:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208024.892933:0:9635:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208024.892937:0:9635:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557038a 00000080:00010000:1.0:1715208024.892946:0:9635:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557038a from it ffff8800b3f13cc8 00010000:00010000:1.0:1715208024.892950:0:9635:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.892960:0:9635:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1715208024.893485:0:9635:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715208024.893491:0:9635:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715208024.893507:0:9635:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208024.893597:0:9635:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893607:0:9635:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893618:0:9635:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9635 initiator: MDT0 00000100:00100000:1.0:1715208024.893648:0:9635:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b39fd780 going to sleep for 0 seconds 00000100:00100000:1.0:1715208024.893663:0:9635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967bb80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:04532c2b-e5e9-420d-abb0-4480aab1e378:9635:1798523505051456:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715208024.893676:0:9635:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893685:0:9635:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893690:0:9635:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893696:0:9635:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893704:0:9635:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893712:0:9635:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa6698c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715208024.893717:0:9635:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893724:0:9635:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893731:0:9635:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893738:0:9635:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208024.893745:0:9635:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 9635 initiator: MDT0 00010000:00010000:1.0:1715208024.893751:0:9635:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd55703bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 9635 initiator: MDT0 00000080:00020000:1.0:1715208024.893780:0:9635:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715208024.893801:0:9635:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715208024.893806:0:9635:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208024.893815:0:9635:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208024.893823:0:9635:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.893832:0:9635:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208024.893840:0:9635:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208024.893843:0:9635:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557038a 00000080:00010000:1.0:1715208024.893847:0:9635:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557038a from it ffff8800b3f13cc8 00010000:00010000:1.0:1715208024.893850:0:9635:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.893857:0:9635:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208024.893947:0:9635:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208024.893957:0:9635:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208024.893964:0:9635:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.893972:0:9635:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208024.893981:0:9635:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208024.893988:0:9635:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557038a 00000080:00010000:1.0:1715208024.893993:0:9635:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557038a from it ffff8800b3f13b80 00010000:00010000:1.0:1715208024.893996:0:9635:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.894004:0:9635:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208024.894013:0:9635:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715208024.894020:0:9635:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:3.0:1715208024.894874:0:9636:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715208024.894893:0:9636:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208024.894904:0:9636:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.894917:0:9636:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208024.894928:0:9636:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715208024.894931:0:9636:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557038a 00000080:00010000:3.0:1715208024.894936:0:9636:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557038a from it ffff8800a92fbb80 00010000:00010000:3.0:1715208024.894940:0:9636:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.894954:0:9636:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208024.894966:0:9636:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715208024.894973:0:9636:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:3.0:1715208024.895000:0:9636:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715208024.895006:0:9636:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208024.895013:0:9636:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.895022:0:9636:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208024.895029:0:9636:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715208024.895032:0:9636:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557038a 00000080:00010000:3.0:1715208024.895035:0:9636:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557038a from it ffff8800a92fbbb0 00010000:00010000:3.0:1715208024.895038:0:9636:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.895045:0:9636:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208024.895052:0:9636:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208024.895058:0:9636:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:3.0:1715208024.895064:0:9636:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff880136f410c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208024.895073:0:9636:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), file ffff8800b3fd1500, open_flags 8000, mode 0 opened 0 00000080:00200000:3.0:1715208024.895080:0:9636:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), intent=open 00000002:00010000:3.0:1715208024.895129:0:9636:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:3.0:1715208024.895172:0:9636:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 9636 initiator: MDT0 00010000:00010000:3.0:1715208024.895180:0:9636:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9636 initiator: MDT0 00000020:00100000:3.0:1715208024.895192:0:9636:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1715208024.895203:0:9636:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a91e7100 x1798523505051584/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1715208024.895214:0:9636:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9636 initiator: MDT0 00000100:00100000:3.0:1715208024.895232:0:9636:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e7100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9636:1798523505051584:192.168.201.123@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1715208024.895445:0:9636:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801373696c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715208024.898015:0:9636:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e7100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9636:1798523505051584:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715208024.898031:0:9636:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9636 initiator: MDT0 00010000:00010000:2.0:1715208024.898042:0:9636:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 9636 initiator: MDT0 00010000:00010000:2.0:1715208024.898049:0:9636:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 9636 initiator: MDT0 00010000:00010000:2.0:1715208024.898055:0:9636:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 9636 initiator: MDT0 00010000:00010000:2.0:1715208024.898062:0:9636:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 9636 initiator: MDT0 00010000:00010000:2.0:1715208024.898067:0:9636:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609d40 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:2.0:1715208024.898070:0:9636:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 9636 initiator: MDT0 00010000:00010000:2.0:1715208024.898076:0:9636:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 9636 initiator: MDT0 00010000:00010000:2.0:1715208024.898082:0:9636:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 9636 initiator: MDT0 00010000:00010000:2.0:1715208024.898089:0:9636:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715208024.898122:0:9636:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 9636 initiator: MDT0 00010000:00010000:2.0:1715208024.898128:0:9636:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609d40/0x7561918bd55703c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 9636 initiator: MDT0 00000002:00100000:2.0:1715208024.898145:0:9636:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800a91e7100 x1798523505051584/t4294967452(4294967452) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208040 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:2.0:1715208024.898160:0:9636:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a91e7100 x1798523505051584/t4294967452(4294967452) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208040 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715208024.898189:0:9636:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 4096 00000080:00200000:2.0:1715208024.898193:0:9636:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b02788c8): rc = 0 00000080:00010000:2.0:1715208024.898198:0:9636:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b02788c8) for lock 0x0 00000080:00200008:2.0:1715208024.898214:0:9636:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:2.0:1715208024.898230:0:9636:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a91e7100 x1798523505051584/t4294967452(4294967452) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208040 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715208024.898304:0:9636:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b02788c8), inode mode 4040 mask 44 00000080:00200080:2.0:1715208024.898381:0:9636:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=8f00f0 00800000:00000080:2.0:1715208024.898396:0:9636:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800aa77bc80 uarg=0000000000000000 00000002:00000080:2.0:1715208024.898413:0:9636:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800aa77bc80 uarg=0000000000000000 00000100:00100000:2.0:1715208024.898451:0:9636:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9636:1798523505051648:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715208024.898518:0:9636:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f000 going to sleep for 11 seconds 00000100:00100000:3.0:1715208024.900219:0:9636:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9636:1798523505051648:192.168.201.123@tcp:59:lhsmtool_posix.0 00000002:00000080:3.0:1715208024.900245:0:9636:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800aa77bc80 uarg=0000000000000000 00000100:00100000:3.0:1715208024.900278:0:9636:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6680 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9636:1798523505051712:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715208024.900346:0:9636:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369d80 going to sleep for 11 seconds 00000100:00100000:2.0:1715208024.901891:0:9636:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6680 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9636:1798523505051712:192.168.201.123@tcp:59:lhsmtool_posix.0 00000080:00200000:3.0:1715208024.905386:0:9637:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715208024.905403:0:9637:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208024.905434:0:9637:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905444:0:9637:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905454:0:9637:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9637 initiator: MDT0 00000100:00100000:3.0:1715208024.905476:0:9637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369000 going to sleep for 0 seconds 00000100:00100000:3.0:1715208024.905484:0:9637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:9637:1798523505051776:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715208024.905494:0:9637:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905500:0:9637:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905507:0:9637:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905513:0:9637:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905519:0:9637:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905524:0:9637:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609f80 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208024.905528:0:9637:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905533:0:9637:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905539:0:9637:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905544:0:9637:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208024.905548:0:9637:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905554:0:9637:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609f80/0x7561918bd55703c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 9637 initiator: MDT0 00000080:00020000:3.0:1715208024.905607:0:9637:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715208024.905640:0:9637:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715208024.905653:0:9637:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208024.905684:0:9637:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905696:0:9637:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905708:0:9637:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9637 initiator: MDT0 00000100:00100000:3.0:1715208024.905722:0:9637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369000 going to sleep for 0 seconds 00000100:00100000:3.0:1715208024.905729:0:9637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:9637:1798523505051840:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715208024.905738:0:9637:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905744:0:9637:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905750:0:9637:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905755:0:9637:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905761:0:9637:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905767:0:9637:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a960a1c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208024.905770:0:9637:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905783:0:9637:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905789:0:9637:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905794:0:9637:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208024.905798:0:9637:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905804:0:9637:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a1c0/0x7561918bd55703d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 9637 initiator: MDT0 00000080:00020000:3.0:1715208024.905822:0:9637:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715208024.905842:0:9637:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208024.905847:0:9637:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715208024.905855:0:9637:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208024.905874:0:9637:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905881:0:9637:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905888:0:9637:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9637 initiator: MDT0 00000100:00100000:3.0:1715208024.905896:0:9637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369000 going to sleep for 0 seconds 00000100:00100000:3.0:1715208024.905902:0:9637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:9637:1798523505051904:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715208024.905909:0:9637:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905914:0:9637:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905925:0:9637:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905931:0:9637:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905937:0:9637:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905942:0:9637:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a960a400 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208024.905945:0:9637:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905950:0:9637:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905955:0:9637:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905960:0:9637:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208024.905964:0:9637:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 9637 initiator: MDT0 00010000:00010000:3.0:1715208024.905969:0:9637:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960a400/0x7561918bd55703d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 9637 initiator: MDT0 00000080:00020000:3.0:1715208024.905984:0:9637:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715208024.920332:0:9641:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208024.920347:0:9641:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208024.920359:0:9641:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.920372:0:9641:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208024.920381:0:9641:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208024.920385:0:9641:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557038a 00000080:00010000:1.0:1715208024.920390:0:9641:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557038a from it ffff8800b3f13e00 00010000:00010000:1.0:1715208024.920394:0:9641:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.920403:0:9641:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208024.920413:0:9641:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 101 00000080:00200000:1.0:1715208024.920420:0:9641:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208024.920432:0:9641:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208024.920439:0:9641:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.920447:0:9641:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208024.920454:0:9641:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208024.920457:0:9641:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557038a 00000080:00010000:1.0:1715208024.920460:0:9641:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557038a from it ffff8800b3f13b58 00010000:00010000:1.0:1715208024.920463:0:9641:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.920470:0:9641:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208024.920479:0:9641:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208024.920488:0:9641:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=d24b.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8), flags=1536 00000080:00200000:1.0:1715208024.920492:0:9641:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208024.920496:0:9641:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208024.920501:0:9641:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.920509:0:9641:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208024.920515:0:9641:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208024.920517:0:9641:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557038a 00000080:00010000:1.0:1715208024.920520:0:9641:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557038a from it ffff8800b3f13be8 00010000:00010000:1.0:1715208024.920528:0:9641:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.920536:0:9641:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208024.920544:0:9641:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 3 00000080:00200000:1.0:1715208024.920549:0:9641:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208024.920554:0:9641:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208024.920559:0:9641:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.920596:0:9641:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208024.920603:0:9641:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208024.920605:0:9641:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557038a 00000080:00010000:1.0:1715208024.920608:0:9641:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557038a from it ffff8800b3f13da0 00010000:00010000:1.0:1715208024.920611:0:9641:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.920618:0:9641:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208024.920626:0:9641:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 3 00000080:00200000:1.0:1715208024.920631:0:9641:0:(namei.c:2044:ll_mkdir()) VFS Op:name=d24b.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8) 00000020:00100000:1.0:1715208024.920678:0:9641:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1715208024.920687:0:9641:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a967bb80 x1798523505052032/t0(0) o36->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 560/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715208024.920718:0:9641:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967bb80 pname:cluuid:pid:xid:nid:opc:job mkdir:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9641:1798523505052032:192.168.201.123@tcp:36:mkdir.0 00000100:00100000:1.0:1715208024.920778:0:9641:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b39fd780 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.923601:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:1.0:1715208024.923741:0:12808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673024 00000100:00100000:1.0:1715208024.923753:0:12808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673024 00000100:00100000:1.0:1715208024.923821:0:12808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 50 00000100:00100000:1.0:1715208024.923832:0:12808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a96a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+5:7128:x1798523510673024:12345-192.168.201.123@tcp:104: 00010000:00010000:1.0:1715208024.923846:0:12808:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208024.923915:0:12808:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715208024.923923:0:12808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a96a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+5:7128:x1798523510673024:12345-192.168.201.123@tcp:104: Request processed in 93us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208024.923933:0:12808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 50 00010000:00010000:3.0:1715208024.924008:0:2469:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715208024.924019:0:2469:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.924031:0:2469:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609440 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208024.924044:0:2469:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.924054:0:2469:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.924062:0:2469:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.924150:0:2469:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.924157:0:2469:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715208024.924195:0:2469:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.924202:0:2469:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609440/0x7561918bd557038a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0xfa8b5bed87892433 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.924219:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715208024.924220:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715208024.924223:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715208024.924241:0:2002:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715208024.924255:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505052096:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1715208024.926614:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505052096:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715208024.929976:0:9641:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967bb80 pname:cluuid:pid:xid:nid:opc:job mkdir:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9641:1798523505052032:192.168.201.123@tcp:36:mkdir.0 00000080:00200000:1.0:1715208024.930007:0:9641:0:(llite_lib.c:3140:ll_read_inode2()) VFS Op:inode=[0x240000403:0xb:0x0](ffff8800b025f8c8) 00000080:00200000:1.0:1715208024.930013:0:9641:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x240000403:0xb:0x0], updating i_size 4096 00000080:00200000:3.0:1715208024.933503:0:9642:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715208024.933523:0:9642:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208024.933616:0:9642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.933640:0:9642:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.933651:0:9642:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00000100:00100000:3.0:1715208024.933668:0:9642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9642:1798523505052160:192.168.201.123@tcp:101:rm.0 00000100:00100000:3.0:1715208024.933714:0:9642:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369000 going to sleep for 11 seconds 00000100:00100000:3.0:1715208024.935557:0:9642:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9642:1798523505052160:192.168.201.123@tcp:101:rm.0 00010000:00010000:3.0:1715208024.935605:0:9642:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.935618:0:9642:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.935630:0:9642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.935640:0:9642:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.935649:0:9642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.935657:0:9642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.935664:0:9642:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1715208024.935690:0:9642:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a91e6d80 x1798523505052160/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 576/688 e 0 to 0 dl 1715208040 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 00000002:00010000:3.0:1715208024.935704:0:9642:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.935713:0:9642:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aa580800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1715208024.935731:0:9642:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1715208024.935736:0:9642:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55703de 00000080:00010000:3.0:1715208024.935741:0:9642:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715208024.935744:0:9642:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55703de from it ffff8800b3efbaf8 00010000:00010000:3.0:1715208024.935747:0:9642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.935754:0:9642:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208024.935770:0:9642:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208024.935779:0:9642:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=d24b.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8), flags=16 00000080:00200000:3.0:1715208024.935783:0:9642:0:(namei.c:838:ll_lookup_it()) VFS Op:name=d24b.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8), intent=0 00000002:00010000:3.0:1715208024.935793:0:9642:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: d24b.sanity-hsm,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1715208024.935815:0:9642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.935822:0:9642:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.935829:0:9642:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00000100:00100000:3.0:1715208024.935854:0:9642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9642:1798523505052224:192.168.201.123@tcp:101:rm.0 00000100:00100000:3.0:1715208024.935915:0:9642:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369000 going to sleep for 11 seconds 00000100:00100000:3.0:1715208024.940820:0:9642:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a9618000: committing for last_committed 4294967452 gen 1 00000100:00100000:3.0:1715208024.940832:0:9642:0:(client.c:3005:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8800a91e7100 x1798523505051584/t4294967452(4294967452) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208040 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000100:00100000:3.0:1715208024.940845:0:9642:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9642:1798523505052224:192.168.201.123@tcp:101:rm.0 00010000:00010000:3.0:1715208024.940862:0:9642:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.940878:0:9642:0:(ldlm_request.c:741:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 4/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.940886:0:9642:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 4/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.940894:0:9642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.940903:0:9642:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.940911:0:9642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 5/2,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.940919:0:9642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 5/2,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.940938:0:9642:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1715208024.940948:0:9642:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a91e6d80 x1798523505052224/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 584/584 e 0 to 0 dl 1715208040 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 00000002:00010000:3.0:1715208024.940958:0:9642:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.940966:0:9642:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aa580800 type 13 mode 4 res 9663677443/11 (0 0) 00000002:00010000:3.0:1715208024.940978:0:9642:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x240000403:0xb:0x0], intent: lookup flags 0 00010000:00010000:3.0:1715208024.941005:0:9642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.941012:0:9642:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.941019:0:9642:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00000100:00100000:3.0:1715208024.941032:0:9642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e7b80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9642:1798523505052288:192.168.201.123@tcp:101:rm.0 00000100:00100000:3.0:1715208024.941093:0:9642:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369000 going to sleep for 11 seconds 00000100:00100000:3.0:1715208024.942992:0:9642:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e7b80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9642:1798523505052288:192.168.201.123@tcp:101:rm.0 00010000:00010000:3.0:1715208024.943010:0:9642:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 4/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789251a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.943021:0:9642:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 4/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789251a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.943044:0:9642:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789251a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.943054:0:9642:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789251a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.943063:0:9642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 5/2,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789251a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.943070:0:9642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 5/2,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789251a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.943076:0:9642:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789251a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1715208024.943086:0:9642:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a91e7b80 x1798523505052288/t0(0) o101->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 576/584 e 0 to 0 dl 1715208040 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 00000002:00010000:3.0:1715208024.943125:0:9642:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789251a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.943136:0:9642:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff88012a56f000 type 13 mode 4 res 9663677443/11 (0 0) 00000080:00200000:3.0:1715208024.943157:0:9642:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x240000403:0xb:0x0], updating i_size 4096 00000080:00200000:3.0:1715208024.943160:0:9642:0:(namei.c:157:ll_iget()) got inode: [0x240000403:0xb:0x0](ffff8800b025f8c8): rc = 0 00000080:00010000:3.0:1715208024.943165:0:9642:0:(llite_internal.h:1957:ll_set_lock_data()) setting l_data to inode [0x240000403:0xb:0x0](ffff8800b025f8c8) for remote lock 0x7561918bd55703ec 00000080:00010000:3.0:1715208024.943170:0:9642:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x240000403:0xb:0x0](ffff8800b025f8c8) for lock 0x7561918bd55703e5 00000080:00010000:3.0:1715208024.943177:0:9642:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x240000403:0xb:0x0](ffff8800b025f8c8) 00000080:00010000:3.0:1715208024.943180:0:9642:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55703e5 from it ffff8800b3efba60 00010000:00010000:3.0:1715208024.943190:0:9642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.943198:0:9642:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a1c0/0x7561918bd55703e5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789250c expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208024.943208:0:9642:0:(dcache.c:206:ll_intent_drop_lock()) releasing remote lock with cookie 0x7561918bd55703ec from it ffff8800b3efba60 00010000:00010000:3.0:1715208024.943211:0:9642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789251a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.943218:0:9642:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a9609f80/0x7561918bd55703ec lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789251a expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208024.943234:0:9642:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x240000403:0xb:0x0](ffff8800b025f8c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208024.943243:0:9642:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=f24b.sanity-hsm, dir=[0x240000403:0xb:0x0](ffff8800b025f8c8), flags=0 00000080:00200000:3.0:1715208024.943246:0:9642:0:(namei.c:838:ll_lookup_it()) VFS Op:name=f24b.sanity-hsm, dir=[0x240000403:0xb:0x0](ffff8800b025f8c8), intent=getattr 00000002:00010000:3.0:1715208024.943257:0:9642:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: f24b.sanity-hsm,[0x0:0x0:0x0]) in obj [0x240000403:0xb:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208024.943281:0:9642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.943288:0:9642:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.943294:0:9642:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00000100:00100000:3.0:1715208024.943309:0:9642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e7b80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9642:1798523505052352:192.168.201.123@tcp:101:rm.0 00000100:00100000:3.0:1715208024.943366:0:9642:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369000 going to sleep for 11 seconds 00000100:00100000:3.0:1715208024.945483:0:9642:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e7b80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9642:1798523505052352:192.168.201.123@tcp:101:rm.0 00010000:00010000:3.0:1715208024.945499:0:9642:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 4/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945518:0:9642:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 4/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945524:0:9642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 4/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945530:0:9642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945537:0:9642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 4/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945542:0:9642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a960a640 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208024.945545:0:9642:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 4/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945551:0:9642:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 4/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945557:0:9642:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 5/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945595:0:9642:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208024.945600:0:9642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945606:0:9642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a640/0x7561918bd55703f3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 9642 initiator: MDT0 00000002:00100000:3.0:1715208024.945628:0:9642:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a91e7b80 x1798523505052352/t0(0) o101->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 584/584 e 0 to 0 dl 1715208040 ref 1 fl Complete:RQU/200/0 rc 301/301 job:'rm.0' uid:0 gid:0 00010000:00010000:3.0:1715208024.945654:0:9642:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff88012a56f000 type 13 mode 30 res 9663677443/11 (0 0) 00000080:00200000:3.0:1715208024.945731:0:9642:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715208024.945742:0:9642:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208024.945751:0:9642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.945761:0:9642:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208024.945768:0:9642:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715208024.945771:0:9642:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55703de 00000080:00010000:3.0:1715208024.945776:0:9642:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55703de from it ffff8800b3efbb90 00010000:00010000:3.0:1715208024.945779:0:9642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.945786:0:9642:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208024.945796:0:9642:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208024.945801:0:9642:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d24b.sanity-hsm, flags=16 00000080:00200000:3.0:1715208024.945805:0:9642:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x240000403:0xb:0x0](ffff8800b025f8c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208024.945811:0:9642:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=f24b.sanity-hsm, dir=[0x240000403:0xb:0x0](ffff8800b025f8c8), flags=0 00000080:00200000:3.0:1715208024.945815:0:9642:0:(namei.c:838:ll_lookup_it()) VFS Op:name=f24b.sanity-hsm, dir=[0x240000403:0xb:0x0](ffff8800b025f8c8), intent=getattr 00000002:00010000:3.0:1715208024.945821:0:9642:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: f24b.sanity-hsm,[0x0:0x0:0x0]) in obj [0x240000403:0xb:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208024.945844:0:9642:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945850:0:9642:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.945857:0:9642:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00000100:00100000:3.0:1715208024.945879:0:9642:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e7b80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9642:1798523505052416:192.168.201.123@tcp:101:rm.0 00000100:00100000:3.0:1715208024.945941:0:9642:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369000 going to sleep for 11 seconds 00000100:00100000:3.0:1715208024.947874:0:9642:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e7b80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9642:1798523505052416:192.168.201.123@tcp:101:rm.0 00010000:00010000:3.0:1715208024.947891:0:9642:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 4/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.947901:0:9642:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 4/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.947908:0:9642:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 4/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.947914:0:9642:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.947920:0:9642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 4/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.947926:0:9642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a960a880 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208024.947929:0:9642:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 4/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.947935:0:9642:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 4/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.947941:0:9642:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 5/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.947946:0:9642:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208024.947950:0:9642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 9642 initiator: MDT0 00010000:00010000:3.0:1715208024.947970:0:9642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960a880/0x7561918bd55703fa lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 9642 initiator: MDT0 00000002:00100000:3.0:1715208024.947984:0:9642:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a91e7b80 x1798523505052416/t0(0) o101->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 584/584 e 0 to 0 dl 1715208040 ref 1 fl Complete:RQU/200/0 rc 301/301 job:'rm.0' uid:0 gid:0 00010000:00010000:3.0:1715208024.948008:0:9642:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff88012a56f000 type 13 mode 30 res 9663677443/11 (0 0) 00000080:00200000:3.0:1715208024.951639:0:9643:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715208024.951655:0:9643:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208024.951666:0:9643:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.951679:0:9643:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208024.951689:0:9643:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715208024.951692:0:9643:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55703de 00000080:00010000:3.0:1715208024.951697:0:9643:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55703de from it ffff8800b3f13bb0 00010000:00010000:3.0:1715208024.951700:0:9643:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.951709:0:9643:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960a400/0x7561918bd55703de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878924f0 expref: -99 pid: 9642 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208024.951719:0:9643:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208024.951724:0:9643:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d24b.sanity-hsm, flags=17 00000080:00200000:3.0:1715208024.951727:0:9643:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x240000403:0xb:0x0](ffff8800b025f8c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208024.951734:0:9643:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x240000403:0xb:0x0](ffff8800b025f8c8), inode mode 41ed mask 3 00000080:00200000:3.0:1715208024.951737:0:9643:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=f24b.sanity-hsm, dir=[0x240000403:0xb:0x0](ffff8800b025f8c8), file ffff880136a0c180, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1715208024.951751:0:9643:0:(namei.c:838:ll_lookup_it()) VFS Op:name=f24b.sanity-hsm, dir=[0x240000403:0xb:0x0](ffff8800b025f8c8), intent=open|creat 00000002:00010000:3.0:1715208024.951763:0:9643:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: f24b.sanity-hsm,[0x240000403:0xc:0x0]) in obj [0x240000403:0xb:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1715208024.951793:0:9643:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 9643 initiator: MDT0 00010000:00010000:3.0:1715208024.951801:0:9643:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9643 initiator: MDT0 00000020:00100000:3.0:1715208024.951809:0:9643:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1715208024.951817:0:9643:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a91e7b80 x1798523505052544/t0(0) o101->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 656/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1715208024.951827:0:9643:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 9643 initiator: MDT0 00000100:00100000:3.0:1715208024.951841:0:9643:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e7b80 pname:cluuid:pid:xid:nid:opc:job dd:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9643:1798523505052544:192.168.201.123@tcp:101:dd.0 00000100:00100000:3.0:1715208024.951947:0:9643:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369000 going to sleep for 11 seconds 00000100:00100000:3.0:1715208024.954668:0:9643:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e7b80 pname:cluuid:pid:xid:nid:opc:job dd:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9643:1798523505052544:192.168.201.123@tcp:101:dd.0 00010000:00010000:3.0:1715208024.954687:0:9643:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 4/0,1 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.954704:0:9643:0:(ldlm_request.c:741:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 4/0,1 mode: --/PR res: [0x240000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.954711:0:9643:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 4/0,1 mode: --/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.954719:0:9643:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 4/0,1 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.954741:0:9643:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 4/0,1 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.954751:0:9643:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 5/1,1 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.954758:0:9643:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 5/1,1 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.954765:0:9643:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1715208024.954774:0:9643:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8800a91e7b80 x1798523505052544/t4294967343(4294967343) o101->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 656/664 e 0 to 0 dl 1715208040 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000002:00100000:3.0:1715208024.954787:0:9643:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a91e7b80 x1798523505052544/t4294967343(4294967343) o101->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 656/664 e 0 to 0 dl 1715208040 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000002:00010000:3.0:1715208024.954799:0:9643:0:(mdc_locks.c:942:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1715208024.954809:0:9643:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1715208024.954817:0:9643:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff88012a56f000 type 13 mode 4 res 9663677443/12 (0 0) 00000080:00200000:3.0:1715208024.954830:0:9643:0:(namei.c:1424:ll_create_it()) VFS Op:name=f24b.sanity-hsm, dir=[0x240000403:0xb:0x0](ffff8800b025f8c8), intent=open|creat 00000080:00200000:3.0:1715208024.954846:0:9643:0:(llite_lib.c:3140:ll_read_inode2()) VFS Op:inode=[0x240000403:0xc:0x0](ffff8800b02650c8) 00000080:00200000:3.0:1715208024.954922:0:9643:0:(file.c:6276:ll_layout_conf()) [0x240000403:0xc:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1715208024.954928:0:9643:0:(namei.c:1391:ll_create_node()) setting l_ast_data to inode [0x240000403:0xc:0x0](ffff8800b02650c8) 00000080:00010000:3.0:1715208024.954937:0:9643:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x240000403:0xc:0x0](ffff8800b02650c8) for lock 0x7561918bd5570401 00000080:00200008:3.0:1715208024.954947:0:9643:0:(file.c:871:ll_file_open()) START file f24b.sanity-hsm:[0x240000403:0xc:0x0](ffff8800b02650c8), flags 101101 00000002:00100000:3.0:1715208024.954962:0:9643:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a91e7b80 x1798523505052544/t4294967343(4294967343) o101->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 584/664 e 0 to 0 dl 1715208040 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000080:00010000:3.0:1715208024.955008:0:9643:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd5570401 from it ffff8800b3f70f60 00010000:00010000:3.0:1715208024.955013:0:9643:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1715208024.955021:0:9643:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff8800a9618000 lock: ffff8800a960aac0/0x7561918bd5570401 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xfa8b5bed87892560 expref: -99 pid: 9643 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1715208024.955033:0:9643:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x240000403:0xc:0x0](ffff8800b02650c8), inode mode 81a4 mask 40 00000080:00200008:3.0:1715208024.972231:0:9643:0:(file.c:2372:ll_file_write_iter()) START file f24b.sanity-hsm:[0x240000403:0xc:0x0], ppos: 0, count: 1048576 00000080:00200000:3.0:1715208024.972244:0:9643:0:(file.c:1812:ll_file_io_generic()) f24b.sanity-hsm: write ppos: 0, bytes: 1048576 00000080:00200000:3.0:1715208024.972250:0:9643:0:(file.c:1599:ll_io_set_mirror()) f24b.sanity-hsm: desiginated mirror: 0 00000020:00200000:3.0:1715208024.972258:0:9643:0:(cl_io.c:195:cl_io_rw_init()) header@ffff8800abf98960[0x4, 1, [0x240000403:0xc:0x0] hash] 00000020:00200000:3.0:1715208024.972261:0:9643:0:(cl_io.c:195:cl_io_rw_init()) io range: 2 [0, 1048576) 0 0 00000080:00200000:3.0:1715208024.972267:0:9643:0:(vvp_io.c:1871:vvp_io_init()) [0x240000403:0xc:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1715208024.972282:0:9643:0:(file.c:1879:ll_file_io_generic()) Range lock [0, 255] 00020000:00200000:3.0:1715208024.972292:0:9643:0:(lov_io.c:1039:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1048576) 1048576, 1048576 00020000:00200000:3.0:1715208024.972297:0:9643:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1715208024.972313:0:9643:0:(file.c:1916:ll_file_io_generic()) Range unlock [0, 255] 00000080:00200000:3.0:1715208024.972322:0:9643:0:(vvp_io.c:304:vvp_io_fini()) [0x240000403:0xc:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1715208024.972326:0:9643:0:(file.c:1950:ll_file_io_generic()) f24b.sanity-hsm: 2 io complete with rc: -5, result: 0, restart: 0 00000080:00200000:3.0:1715208024.972337:0:9643:0:(file.c:1528:ll_merge_attr_nolock()) [0x240000403:0xc:0x0] updating i_size 0 i_blocks 0 00000080:00200000:3.0:1715208024.972340:0:9643:0:(file.c:2030:ll_file_io_generic()) iot: 2, result: 0 00000080:00200008:3.0:1715208024.972790:0:9643:0:(file.c:430:ll_file_release()) START file f24b.sanity-hsm:[0x240000403:0xc:0x0](ffff8800b02650c8), flags 100001 00000002:00100000:3.0:1715208024.972824:0:9643:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff8800a91e7b80 x1798523505052544/t4294967343(4294967343) o101->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 584/664 e 0 to 0 dl 1715208040 ref 1 fl Complete:RPQU/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000020:00100000:3.0:1715208024.972847:0:9643:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1715208024.972860:0:9643:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a91e6d80 x1798523505052672/t0(0) o35->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715208024.972877:0:9643:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job dd:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9643:1798523505052672:192.168.201.123@tcp:35:dd.0 00000100:00100000:3.0:1715208024.972922:0:9643:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137369540 going to sleep for 11 seconds 00000100:00100000:3.0:1715208024.974771:0:9643:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6d80 pname:cluuid:pid:xid:nid:opc:job dd:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:9643:1798523505052672:192.168.201.123@tcp:35:dd.0 00000002:00100000:3.0:1715208024.974798:0:9643:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a91e7b80 x1798523505052544/t4294967343(4294967343) o101->lustre-MDT0001-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 584/664 e 0 to 0 dl 1715208040 ref 1 fl Complete:RQU/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000001:02000400:1.0:1715208025.484711:0:9777:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_24b: @@@@@@ FAIL: cannot create /mnt/lustre2/d24b.sanity-hsm/f24b.sanity-hsm with dd, status=1 00010000:00010000:3.0:1715208025.766818:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 499 lines, 499 kept, 0 dropped, 0 bad.