00000100:00080000:2.0F:1715209736.664739:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209736.664754:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715209736.664768:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209736.664771:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715209736.664786:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209736.664789:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715209736.664829:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523505186048:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0F:1715209736.664866:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2002:1798523505186112:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209736.664939:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505186176:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209736.664943:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505186240:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209736.664960:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505186304:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209736.666605:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523505186048:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209736.666627:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505186176:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209736.666630:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2002:1798523505186112:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209736.666643:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505186240:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209736.666649:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505186304:192.168.201.123@tcp:400:kworker.0 00010000:00010000:1.0F:1715209737.188749:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:3.0:1715209737.198688:0:5175:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=11870f0 00800000:00000080:3.0:1715209737.198731:0:5175:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b5edc3c0 uarg=0000000000000000 00000002:00000080:3.0:1715209737.198757:0:5175:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b5edc3c0 uarg=0000000000000000 00000100:00100000:3.0:1715209737.198818:0:5175:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:5175:1798523505186368:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1715209737.198905:0:5175:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5ff2180 going to sleep for 11 seconds 00000100:00100000:3.0:1715209737.204277:0:5175:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:5175:1798523505186368:192.168.201.123@tcp:60:lhsmtool_posix.0 00000002:00000080:3.0:1715209737.204300:0:5175:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b5edc3c0 uarg=0000000000000000 00000100:00100000:3.0:1715209737.204326:0:5175:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:5175:1798523505186432:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1715209737.204382:0:5175:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5ff2180 going to sleep for 11 seconds 00000100:00100000:3.0:1715209737.210319:0:5175:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:5175:1798523505186432:192.168.201.123@tcp:60:lhsmtool_posix.0 00000080:00200008:3.0:1715209737.210367:0:5175:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:3.0:1715209737.210412:0:5175:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff8800a91e7800 x1798523505171712/t4294967504(4294967504) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209548 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:3.0:1715209737.210440:0:5175:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1715209737.210446:0:5175:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a91e6a00 x1798523505186560/t0(0) o35->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715209737.210463:0:5175:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:5175:1798523505186560:192.168.201.123@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1715209737.210534:0:5175:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5ff2180 going to sleep for 11 seconds 00000100:00100000:3.0:1715209737.212178:0:5175:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:5175:1798523505186560:192.168.201.123@tcp:35:lhsmtool_posix.0 00000002:00100000:3.0:1715209737.212205:0:5175:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a91e7800 x1798523505171712/t4294967504(4294967504) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209548 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:3.0:1715209737.212250:0:5175:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200008:2.0:1715209737.215284:0:5175:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00010000:00010000:2.0:1715209738.190711:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1715209739.192811:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715209740.048721:0:7799:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 29c: Archive/delete/remove by FID, using a file list. ========================================================== 19:08:59 (1715209739) 00000080:00200008:1.0:1715209740.175728:0:7842:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715209740.175740:0:7842:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715209740.175770:0:7842:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.175794:0:7842:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.175812:0:7842:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715209740.175826:0:7842:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715209740.175829:0:7842:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55708e6 00000080:00010000:1.0:1715209740.175840:0:7842:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55708e6 from it ffff88012a44bcc8 00010000:00010000:1.0:1715209740.175845:0:7842:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.175855:0:7842:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1715209740.176331:0:7842:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715209740.176337:0:7842:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715209740.176353:0:7842:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.176412:0:7842:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176421:0:7842:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176432:0:7842:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7842 initiator: MDT0 00000100:00100000:1.0:1715209740.176462:0:7842:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a90c8480 going to sleep for 0 seconds 00000100:00100000:1.0:1715209740.176477:0:7842:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:04532c2b-e5e9-420d-abb0-4480aab1e378:7842:1798523505186624:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715209740.176491:0:7842:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176499:0:7842:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176506:0:7842:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176512:0:7842:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176520:0:7842:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176526:0:7842:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa54b180 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715209740.176531:0:7842:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176538:0:7842:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176546:0:7842:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176552:0:7842:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715209740.176559:0:7842:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 7842 initiator: MDT0 00010000:00010000:1.0:1715209740.176593:0:7842:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54b180/0x7561918bd5570917 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 7842 initiator: MDT0 00000080:00020000:1.0:1715209740.176624:0:7842:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715209740.176644:0:7842:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715209740.176670:0:7842:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715209740.176680:0:7842:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.176688:0:7842:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.176698:0:7842:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715209740.176706:0:7842:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715209740.176709:0:7842:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55708e6 00000080:00010000:1.0:1715209740.176713:0:7842:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55708e6 from it ffff88012a44bcc8 00010000:00010000:1.0:1715209740.176717:0:7842:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.176725:0:7842:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715209740.176811:0:7842:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715209740.176821:0:7842:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.176827:0:7842:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.176836:0:7842:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715209740.176844:0:7842:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715209740.176852:0:7842:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55708e6 00000080:00010000:1.0:1715209740.176856:0:7842:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55708e6 from it ffff88012a44bb80 00010000:00010000:1.0:1715209740.176860:0:7842:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.176867:0:7842:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715209740.176877:0:7842:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715209740.176884:0:7842:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:3.0:1715209740.177756:0:7843:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715209740.177775:0:7843:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715209740.177786:0:7843:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209740.177799:0:7843:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715209740.177810:0:7843:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715209740.177813:0:7843:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55708e6 00000080:00010000:3.0:1715209740.177818:0:7843:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55708e6 from it ffff88012ab5bb80 00010000:00010000:3.0:1715209740.177822:0:7843:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209740.177831:0:7843:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715209740.177841:0:7843:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715209740.177847:0:7843:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:3.0:1715209740.177873:0:7843:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715209740.177878:0:7843:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715209740.177884:0:7843:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209740.177898:0:7843:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715209740.177906:0:7843:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715209740.177908:0:7843:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55708e6 00000080:00010000:3.0:1715209740.177912:0:7843:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55708e6 from it ffff88012ab5bbb0 00010000:00010000:3.0:1715209740.177914:0:7843:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209740.177921:0:7843:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715209740.177929:0:7843:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715209740.177936:0:7843:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:3.0:1715209740.177941:0:7843:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff880136f410c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715209740.177949:0:7843:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), file ffff8800b63ff980, open_flags 8000, mode 0 opened 0 00000080:00200000:3.0:1715209740.177956:0:7843:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), intent=open 00000002:00010000:3.0:1715209740.177968:0:7843:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:3.0:1715209740.178009:0:7843:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7843 initiator: MDT0 00010000:00010000:3.0:1715209740.178016:0:7843:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7843 initiator: MDT0 00000020:00100000:3.0:1715209740.178026:0:7843:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1715209740.178038:0:7843:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a91e6a00 x1798523505186752/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1715209740.178049:0:7843:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7843 initiator: MDT0 00000100:00100000:3.0:1715209740.178072:0:7843:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505186752:192.168.201.123@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1715209740.178262:0:7843:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5ff2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1715209740.181135:0:7843:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505186752:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715209740.181151:0:7843:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7843 initiator: MDT0 00010000:00010000:2.0:1715209740.181162:0:7843:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 7843 initiator: MDT0 00010000:00010000:2.0:1715209740.181169:0:7843:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 7843 initiator: MDT0 00010000:00010000:2.0:1715209740.181183:0:7843:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 7843 initiator: MDT0 00010000:00010000:2.0:1715209740.181189:0:7843:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 7843 initiator: MDT0 00010000:00010000:2.0:1715209740.181194:0:7843:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a96098c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:2.0:1715209740.181198:0:7843:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 7843 initiator: MDT0 00010000:00010000:2.0:1715209740.181203:0:7843:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 7843 initiator: MDT0 00010000:00010000:2.0:1715209740.181209:0:7843:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 7843 initiator: MDT0 00010000:00010000:2.0:1715209740.181215:0:7843:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715209740.181219:0:7843:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 7843 initiator: MDT0 00010000:00010000:2.0:1715209740.181224:0:7843:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a96098c0/0x7561918bd557091e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 7843 initiator: MDT0 00000002:00100000:2.0:1715209740.181241:0:7843:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800a91e6a00 x1798523505186752/t4294967508(4294967508) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209756 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:2.0:1715209740.181256:0:7843:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a91e6a00 x1798523505186752/t4294967508(4294967508) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209756 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715209740.181285:0:7843:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 4096 00000080:00200000:2.0:1715209740.181288:0:7843:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b02788c8): rc = 0 00000080:00010000:2.0:1715209740.181294:0:7843:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b02788c8) for lock 0x0 00000080:00200008:2.0:1715209740.181309:0:7843:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:2.0:1715209740.181331:0:7843:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a91e6a00 x1798523505186752/t4294967508(4294967508) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209756 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715209740.181390:0:7843:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b02788c8), inode mode 4040 mask 44 00000080:00200080:2.0:1715209740.181446:0:7843:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=20b30f0 00800000:00000080:2.0:1715209740.181458:0:7843:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff88013640b940 uarg=0000000000000000 00000002:00000080:2.0:1715209740.181470:0:7843:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff88013640b940 uarg=0000000000000000 00000100:00100000:2.0:1715209740.181498:0:7843:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2dc00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505186816:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715209740.181557:0:7843:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa4bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715209740.183415:0:7843:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2dc00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505186816:192.168.201.123@tcp:59:lhsmtool_posix.0 00000002:00000080:3.0:1715209740.183436:0:7843:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff88013640b940 uarg=0000000000000000 00000100:00100000:3.0:1715209740.183464:0:7843:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e7800 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505186880:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715209740.183522:0:7843:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5ff29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715209740.185284:0:7843:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e7800 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505186880:192.168.201.123@tcp:59:lhsmtool_posix.0 00000080:00200000:3.0:1715209740.187867:0:7844:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715209740.187884:0:7844:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715209740.187914:0:7844:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.187924:0:7844:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.187932:0:7844:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7844 initiator: MDT0 00000100:00100000:3.0:1715209740.187943:0:7844:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5ff29c0 going to sleep for 0 seconds 00000100:00100000:3.0:1715209740.187951:0:7844:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5180 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:7844:1798523505186944:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715209740.187960:0:7844:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.187966:0:7844:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.187972:0:7844:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.187989:0:7844:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.187996:0:7844:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188001:0:7844:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609b00 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715209740.188004:0:7844:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188010:0:7844:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188016:0:7844:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188022:0:7844:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715209740.188026:0:7844:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188031:0:7844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd5570925 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 7844 initiator: MDT0 00000080:00020000:3.0:1715209740.188048:0:7844:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715209740.188073:0:7844:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715209740.188082:0:7844:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715209740.188101:0:7844:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188108:0:7844:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188114:0:7844:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7844 initiator: MDT0 00000100:00100000:3.0:1715209740.188129:0:7844:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5ff29c0 going to sleep for 0 seconds 00000100:00100000:3.0:1715209740.188135:0:7844:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5180 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:7844:1798523505187008:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715209740.188142:0:7844:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188148:0:7844:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188153:0:7844:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188159:0:7844:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188164:0:7844:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188169:0:7844:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609440 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715209740.188172:0:7844:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188178:0:7844:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188183:0:7844:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188188:0:7844:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715209740.188191:0:7844:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188196:0:7844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557092c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 7844 initiator: MDT0 00000080:00020000:3.0:1715209740.188215:0:7844:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715209740.188232:0:7844:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715209740.188236:0:7844:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715209740.188244:0:7844:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715209740.188260:0:7844:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188267:0:7844:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188273:0:7844:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7844 initiator: MDT0 00000100:00100000:3.0:1715209740.188281:0:7844:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5ff29c0 going to sleep for 0 seconds 00000100:00100000:3.0:1715209740.188286:0:7844:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5180 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:7844:1798523505187072:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715209740.188292:0:7844:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188298:0:7844:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188304:0:7844:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188310:0:7844:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188315:0:7844:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188320:0:7844:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609d40 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715209740.188328:0:7844:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188334:0:7844:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188340:0:7844:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188344:0:7844:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715209740.188347:0:7844:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 7844 initiator: MDT0 00010000:00010000:3.0:1715209740.188353:0:7844:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd5570933 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 7844 initiator: MDT0 00000080:00020000:3.0:1715209740.188366:0:7844:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:0.0:1715209740.194834:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1715209740.202151:0:7848:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715209740.202166:0:7848:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.202177:0:7848:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.202189:0:7848:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715209740.202199:0:7848:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715209740.202202:0:7848:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55708e6 00000080:00010000:1.0:1715209740.202207:0:7848:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55708e6 from it ffff8800aa69fe00 00010000:00010000:1.0:1715209740.202210:0:7848:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.202219:0:7848:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715209740.202230:0:7848:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 101 00000080:00200000:1.0:1715209740.202236:0:7848:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715209740.202248:0:7848:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.202254:0:7848:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.202262:0:7848:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715209740.202269:0:7848:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715209740.202271:0:7848:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55708e6 00000080:00010000:1.0:1715209740.202274:0:7848:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55708e6 from it ffff8800aa69fb58 00010000:00010000:1.0:1715209740.202277:0:7848:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.202284:0:7848:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715209740.202292:0:7848:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715209740.202300:0:7848:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=d29c.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8), flags=1536 00000080:00200000:1.0:1715209740.202303:0:7848:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715209740.202307:0:7848:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.202312:0:7848:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.202319:0:7848:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715209740.202325:0:7848:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715209740.202327:0:7848:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55708e6 00000080:00010000:1.0:1715209740.202330:0:7848:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55708e6 from it ffff8800aa69fbe8 00010000:00010000:1.0:1715209740.202337:0:7848:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.202344:0:7848:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715209740.202352:0:7848:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 3 00000080:00200000:1.0:1715209740.202356:0:7848:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715209740.202361:0:7848:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.202366:0:7848:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.202373:0:7848:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715209740.202379:0:7848:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715209740.202382:0:7848:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55708e6 00000080:00010000:1.0:1715209740.202384:0:7848:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55708e6 from it ffff8800aa69fda0 00010000:00010000:1.0:1715209740.202387:0:7848:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.202394:0:7848:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715209740.202401:0:7848:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 3 00000080:00200000:1.0:1715209740.202405:0:7848:0:(namei.c:2044:ll_mkdir()) VFS Op:name=d29c.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8) 00800000:00000004:1.0:1715209740.202428:0:7848:0:(obd_class.h:1105:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800a9618000: age 97, max_age 0 00010000:00010000:1.0:1715209740.202484:0:7848:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.202529:0:7848:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.202536:0:7848:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715209740.202539:0:7848:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55708e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xfa8b5bed87892cc2 expref: -99 pid: 5181 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1715209740.202558:0:7848:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1715209740.202593:0:7848:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9679500 x1798523505187264/t0(0) o36->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 560/792 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715209740.202610:0:7848:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9679500 pname:cluuid:pid:xid:nid:opc:job mkdir:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7848:1798523505187264:192.168.201.123@tcp:36:mkdir.0 00000100:00100000:0.0:1715209740.202635:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505187136:192.168.201.123@tcp:41:mkdir.0 00000100:00100000:1.0:1715209740.202677:0:7848:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a90c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1715209740.204369:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505187136:192.168.201.123@tcp:41:mkdir.0 00000100:00100000:1.0:1715209740.205320:0:7848:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9679500 pname:cluuid:pid:xid:nid:opc:job mkdir:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7848:1798523505187264:192.168.201.123@tcp:36:mkdir.0 00000080:00200000:1.0:1715209740.205353:0:7848:0:(llite_lib.c:3140:ll_read_inode2()) VFS Op:inode=[0x200000403:0x15:0x0](ffff8800a840b0c8) 00000080:00200000:1.0:1715209740.205359:0:7848:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000403:0x15:0x0], updating i_size 4096 00000080:00200000:1.0:1715209740.209030:0:7849:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715209740.209047:0:7849:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.209076:0:7849:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.209085:0:7849:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.209093:0:7849:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7849 initiator: MDT0 00000100:00100000:1.0:1715209740.209109:0:7849:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7849:1798523505187328:192.168.201.123@tcp:101:rm.0 00000100:00100000:1.0:1715209740.209173:0:7849:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a90c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1715209740.211046:0:7849:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7849:1798523505187328:192.168.201.123@tcp:101:rm.0 00010000:00010000:1.0:1715209740.211066:0:7849:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.211078:0:7849:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.211091:0:7849:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.211101:0:7849:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.211110:0:7849:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.211117:0:7849:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.211125:0:7849:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1715209740.211135:0:7849:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a967aa00 x1798523505187328/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 576/688 e 0 to 0 dl 1715209756 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 00000002:00010000:1.0:1715209740.211147:0:7849:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.211157:0:7849:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aa580800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1715209740.211183:0:7849:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1715209740.211189:0:7849:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557093a 00000080:00010000:1.0:1715209740.211195:0:7849:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715209740.211198:0:7849:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557093a from it ffff8800a4cfbaf8 00010000:00010000:1.0:1715209740.211201:0:7849:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.211209:0:7849:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715209740.211224:0:7849:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715209740.211232:0:7849:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=d29c.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8), flags=16 00000080:00200000:1.0:1715209740.211236:0:7849:0:(namei.c:838:ll_lookup_it()) VFS Op:name=d29c.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8), intent=0 00000002:00010000:1.0:1715209740.211247:0:7849:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: d29c.sanity-hsm,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1715209740.211269:0:7849:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.211276:0:7849:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.211283:0:7849:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7849 initiator: MDT0 00000100:00100000:1.0:1715209740.211298:0:7849:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7849:1798523505187392:192.168.201.123@tcp:101:rm.0 00000100:00100000:1.0:1715209740.211356:0:7849:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a90c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1715209740.213447:0:7849:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7849:1798523505187392:192.168.201.123@tcp:101:rm.0 00010000:00010000:1.0:1715209740.213466:0:7849:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.213503:0:7849:0:(ldlm_request.c:741:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.213510:0:7849:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.213519:0:7849:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.213527:0:7849:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.213537:0:7849:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.213544:0:7849:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.213551:0:7849:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1715209740.213592:0:7849:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a967aa00 x1798523505187392/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 584/584 e 0 to 0 dl 1715209756 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 00000002:00010000:1.0:1715209740.213604:0:7849:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.213613:0:7849:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aa580800 type 13 mode 4 res 8589935619/21 (0 0) 00000080:00200000:1.0:1715209740.213625:0:7849:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000403:0x15:0x0], updating i_size 4096 00000080:00200000:1.0:1715209740.213634:0:7849:0:(namei.c:157:ll_iget()) got inode: [0x200000403:0x15:0x0](ffff8800a840b0c8): rc = 0 00000080:00010000:1.0:1715209740.213640:0:7849:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000403:0x15:0x0](ffff8800a840b0c8) for lock 0x7561918bd5570941 00000080:00010000:1.0:1715209740.213675:0:7849:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x15:0x0](ffff8800a840b0c8) 00000080:00010000:1.0:1715209740.213678:0:7849:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd5570941 from it ffff8800a4cfba60 00010000:00010000:1.0:1715209740.213682:0:7849:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.213690:0:7849:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd5570941 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d94 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715209740.213710:0:7849:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000403:0x15:0x0](ffff8800a840b0c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715209740.213718:0:7849:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=f29c.sanity-hsm-1, dir=[0x200000403:0x15:0x0](ffff8800a840b0c8), flags=0 00000080:00200000:1.0:1715209740.213722:0:7849:0:(namei.c:838:ll_lookup_it()) VFS Op:name=f29c.sanity-hsm-1, dir=[0x200000403:0x15:0x0](ffff8800a840b0c8), intent=getattr 00000002:00010000:1.0:1715209740.213732:0:7849:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: f29c.sanity-hsm-1,[0x0:0x0:0x0]) in obj [0x200000403:0x15:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.213756:0:7849:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.213762:0:7849:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.213769:0:7849:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7849 initiator: MDT0 00000100:00100000:1.0:1715209740.213784:0:7849:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7849:1798523505187456:192.168.201.123@tcp:101:rm.0 00000100:00100000:1.0:1715209740.213844:0:7849:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a90c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1715209740.215811:0:7849:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7849:1798523505187456:192.168.201.123@tcp:101:rm.0 00010000:00010000:1.0:1715209740.215827:0:7849:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.215838:0:7849:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.215853:0:7849:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.215859:0:7849:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.215866:0:7849:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.215871:0:7849:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa54a880 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715209740.215874:0:7849:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.215880:0:7849:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.215886:0:7849:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 5/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.215891:0:7849:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715209740.215895:0:7849:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.215901:0:7849:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a880/0x7561918bd5570948 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 7849 initiator: MDT0 00000002:00100000:1.0:1715209740.215915:0:7849:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a967aa00 x1798523505187456/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 592/584 e 0 to 0 dl 1715209756 ref 1 fl Complete:RQU/200/0 rc 301/301 job:'rm.0' uid:0 gid:0 00010000:00010000:1.0:1715209740.215939:0:7849:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aa580800 type 13 mode 30 res 8589935619/21 (0 0) 00000080:00200000:1.0:1715209740.216008:0:7849:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715209740.216017:0:7849:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.216032:0:7849:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.216042:0:7849:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715209740.216051:0:7849:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715209740.216053:0:7849:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557093a 00000080:00010000:1.0:1715209740.216058:0:7849:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557093a from it ffff8800a4cfbb90 00010000:00010000:1.0:1715209740.216062:0:7849:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.216070:0:7849:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715209740.216080:0:7849:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715209740.216085:0:7849:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d29c.sanity-hsm, flags=16 00000080:00200000:1.0:1715209740.216088:0:7849:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000403:0x15:0x0](ffff8800a840b0c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715209740.216095:0:7849:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=f29c.sanity-hsm-1, dir=[0x200000403:0x15:0x0](ffff8800a840b0c8), flags=0 00000080:00200000:1.0:1715209740.216099:0:7849:0:(namei.c:838:ll_lookup_it()) VFS Op:name=f29c.sanity-hsm-1, dir=[0x200000403:0x15:0x0](ffff8800a840b0c8), intent=getattr 00000002:00010000:1.0:1715209740.216106:0:7849:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: f29c.sanity-hsm-1,[0x0:0x0:0x0]) in obj [0x200000403:0x15:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.216128:0:7849:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.216135:0:7849:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.216142:0:7849:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7849 initiator: MDT0 00000100:00100000:1.0:1715209740.216156:0:7849:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7849:1798523505187520:192.168.201.123@tcp:101:rm.0 00000100:00100000:1.0:1715209740.216224:0:7849:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a90c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1715209740.218117:0:7849:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7849:1798523505187520:192.168.201.123@tcp:101:rm.0 00010000:00010000:1.0:1715209740.218134:0:7849:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 4/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.218144:0:7849:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 4/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.218151:0:7849:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 4/1,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.218157:0:7849:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.218163:0:7849:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 4/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.218168:0:7849:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa54b3c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715209740.218172:0:7849:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 4/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.218177:0:7849:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 4/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.218183:0:7849:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 5/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.218188:0:7849:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715209740.218192:0:7849:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 7849 initiator: MDT0 00010000:00010000:1.0:1715209740.218198:0:7849:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd557094f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 7849 initiator: MDT0 00000002:00100000:1.0:1715209740.218225:0:7849:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a967aa00 x1798523505187520/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 592/584 e 0 to 0 dl 1715209756 ref 1 fl Complete:RQU/200/0 rc 301/301 job:'rm.0' uid:0 gid:0 00010000:00010000:1.0:1715209740.218248:0:7849:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aa580800 type 13 mode 30 res 8589935619/21 (0 0) 00000080:00200000:1.0:1715209740.222073:0:7850:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715209740.222089:0:7850:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715209740.222100:0:7850:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.222112:0:7850:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715209740.222122:0:7850:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715209740.222125:0:7850:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557093a 00000080:00010000:1.0:1715209740.222130:0:7850:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557093a from it ffff8800a98f7bb0 00010000:00010000:1.0:1715209740.222134:0:7850:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.222142:0:7850:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715209740.222152:0:7850:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715209740.222157:0:7850:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d29c.sanity-hsm, flags=17 00000080:00200000:1.0:1715209740.222161:0:7850:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000403:0x15:0x0](ffff8800a840b0c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715209740.222167:0:7850:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000403:0x15:0x0](ffff8800a840b0c8), inode mode 41ed mask 3 00000080:00200000:1.0:1715209740.222171:0:7850:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=f29c.sanity-hsm-1, dir=[0x200000403:0x15:0x0](ffff8800a840b0c8), file ffff8800b7af3980, open_flags 8241, mode 81b6 opened 0 00000080:00200000:1.0:1715209740.222178:0:7850:0:(namei.c:838:ll_lookup_it()) VFS Op:name=f29c.sanity-hsm-1, dir=[0x200000403:0x15:0x0](ffff8800a840b0c8), intent=open|creat 00000002:00010000:1.0:1715209740.222188:0:7850:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: f29c.sanity-hsm-1,[0x200000403:0x16:0x0]) in obj [0x200000403:0x15:0x0], intent: open|creat flags 0101102 00010000:00010000:1.0:1715209740.222223:0:7850:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7850 initiator: MDT0 00010000:00010000:1.0:1715209740.222231:0:7850:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7850 initiator: MDT0 00000020:00100000:1.0:1715209740.222239:0:7850:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1715209740.222247:0:7850:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a967aa00 x1798523505187648/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 880/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1715209740.222257:0:7850:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7850 initiator: MDT0 00000100:00100000:1.0:1715209740.222271:0:7850:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job dd:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7850:1798523505187648:192.168.201.123@tcp:101:dd.0 00000100:00100000:1.0:1715209740.222415:0:7850:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a90c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1715209740.224902:0:7850:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967aa00 pname:cluuid:pid:xid:nid:opc:job dd:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7850:1798523505187648:192.168.201.123@tcp:101:dd.0 00010000:00010000:1.0:1715209740.224921:0:7850:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.224936:0:7850:0:(ldlm_request.c:741:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 4/0,1 mode: --/PR res: [0x200000403:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.224945:0:7850:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 4/0,1 mode: --/PR res: [0x200000403:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.224953:0:7850:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 4/0,1 mode: PR/PR res: [0x200000403:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.224962:0:7850:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 4/0,1 mode: PR/PR res: [0x200000403:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.224985:0:7850:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 5/1,1 mode: PR/PR res: [0x200000403:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.224992:0:7850:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 5/1,1 mode: PR/PR res: [0x200000403:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209740.224999:0:7850:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1715209740.225009:0:7850:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff8800a967aa00 x1798523505187648/t4294967510(4294967510) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 880/664 e 0 to 0 dl 1715209756 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000002:00100000:1.0:1715209740.225021:0:7850:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a967aa00 x1798523505187648/t4294967510(4294967510) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 880/664 e 0 to 0 dl 1715209756 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000002:00010000:1.0:1715209740.225033:0:7850:0:(mdc_locks.c:942:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1715209740.225043:0:7850:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1715209740.225051:0:7850:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aa580800 type 13 mode 4 res 8589935619/22 (0 0) 00000080:00200000:1.0:1715209740.225063:0:7850:0:(namei.c:1424:ll_create_it()) VFS Op:name=f29c.sanity-hsm-1, dir=[0x200000403:0x15:0x0](ffff8800a840b0c8), intent=open|creat 00000080:00200000:1.0:1715209740.225144:0:7850:0:(llite_lib.c:3140:ll_read_inode2()) VFS Op:inode=[0x200000403:0x16:0x0](ffff8800a840b8c8) 00000080:00200000:1.0:1715209740.225222:0:7850:0:(file.c:6276:ll_layout_conf()) [0x200000403:0x16:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:1.0:1715209740.225227:0:7850:0:(namei.c:1391:ll_create_node()) setting l_ast_data to inode [0x200000403:0x16:0x0](ffff8800a840b8c8) 00000080:00010000:1.0:1715209740.225231:0:7850:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000403:0x16:0x0](ffff8800a840b8c8) for lock 0x7561918bd5570956 00000080:00200008:1.0:1715209740.225241:0:7850:0:(file.c:871:ll_file_open()) START file f29c.sanity-hsm-1:[0x200000403:0x16:0x0](ffff8800a840b8c8), flags 101101 00000002:00100000:1.0:1715209740.225255:0:7850:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a967aa00 x1798523505187648/t4294967510(4294967510) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 592/664 e 0 to 0 dl 1715209756 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000080:00010000:1.0:1715209740.225311:0:7850:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd5570956 from it ffff8800aa5f91e0 00010000:00010000:1.0:1715209740.225315:0:7850:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1715209740.225324:0:7850:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54a1c0/0x7561918bd5570956 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xfa8b5bed87892dda expref: -99 pid: 7850 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1715209740.225335:0:7850:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000403:0x16:0x0](ffff8800a840b8c8), inode mode 81a4 mask 40 00000080:00200008:1.0:1715209740.241445:0:7850:0:(file.c:2372:ll_file_write_iter()) START file f29c.sanity-hsm-1:[0x200000403:0x16:0x0], ppos: 0, count: 1048576 00000080:00200000:1.0:1715209740.241456:0:7850:0:(file.c:1812:ll_file_io_generic()) f29c.sanity-hsm-1: write ppos: 0, bytes: 1048576 00000080:00200000:1.0:1715209740.241462:0:7850:0:(file.c:1599:ll_io_set_mirror()) f29c.sanity-hsm-1: desiginated mirror: 0 00000020:00200000:1.0:1715209740.241471:0:7850:0:(cl_io.c:195:cl_io_rw_init()) header@ffff8800b63d6640[0x4, 1, [0x200000403:0x16:0x0] hash] 00000020:00200000:1.0:1715209740.241474:0:7850:0:(cl_io.c:195:cl_io_rw_init()) io range: 2 [0, 1048576) 0 0 00000080:00200000:1.0:1715209740.241480:0:7850:0:(vvp_io.c:1871:vvp_io_init()) [0x200000403:0x16:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1715209740.241495:0:7850:0:(file.c:1879:ll_file_io_generic()) Range lock [0, 255] 00020000:00200000:1.0:1715209740.241505:0:7850:0:(lov_io.c:1039:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1048576) 1048576, 1048576 00020000:00200000:1.0:1715209740.241510:0:7850:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1715209740.241525:0:7850:0:(file.c:1916:ll_file_io_generic()) Range unlock [0, 255] 00000080:00200000:1.0:1715209740.241534:0:7850:0:(vvp_io.c:304:vvp_io_fini()) [0x200000403:0x16:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1715209740.241538:0:7850:0:(file.c:1950:ll_file_io_generic()) f29c.sanity-hsm-1: 2 io complete with rc: -5, result: 0, restart: 0 00000080:00200000:1.0:1715209740.241548:0:7850:0:(file.c:1528:ll_merge_attr_nolock()) [0x200000403:0x16:0x0] updating i_size 0 i_blocks 0 00000080:00200000:1.0:1715209740.241552:0:7850:0:(file.c:2030:ll_file_io_generic()) iot: 2, result: 0 00000080:00200008:1.0:1715209740.241993:0:7850:0:(file.c:430:ll_file_release()) START file f29c.sanity-hsm-1:[0x200000403:0x16:0x0](ffff8800a840b8c8), flags 100001 00000002:00100000:1.0:1715209740.242023:0:7850:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff8800a967aa00 x1798523505187648/t4294967510(4294967510) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 592/664 e 0 to 0 dl 1715209756 ref 1 fl Complete:RPQU/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000020:00100000:1.0:1715209740.242044:0:7850:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1715209740.242050:0:7850:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9679f80 x1798523505187776/t0(0) o35->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715209740.242078:0:7850:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9679f80 pname:cluuid:pid:xid:nid:opc:job dd:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7850:1798523505187776:192.168.201.123@tcp:35:dd.0 00000100:00100000:1.0:1715209740.242134:0:7850:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a90c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715209740.243948:0:7850:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9679f80 pname:cluuid:pid:xid:nid:opc:job dd:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7850:1798523505187776:192.168.201.123@tcp:35:dd.0 00000002:00100000:1.0:1715209740.243974:0:7850:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a967aa00 x1798523505187648/t4294967510(4294967510) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 592/664 e 0 to 0 dl 1715209756 ref 1 fl Complete:RQU/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000001:02000400:3.0:1715209740.755176:0:7985:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_29c: @@@@@@ FAIL: cannot create /mnt/lustre2/d29c.sanity-hsm/f29c.sanity-hsm-1 with dd, status=1 00010000:00010000:1.0:1715209741.196828:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 457 lines, 457 kept, 0 dropped, 0 bad.