00000100:00080000:2.0F:1715206898.376694:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715206898.376709:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715206898.376724:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715206898.376727:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715206898.376743:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715206898.376747:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0F:1715206898.376749:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504949760:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715206898.376791:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2002:1798523504949824:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715206898.376864:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523504949888:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715206898.376882:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523504949952:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715206898.376893:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523504950016:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715206898.378634:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504949760:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715206898.378666:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523504950016:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715206898.378756:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523504949888:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715206898.378799:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2002:1798523504949824:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715206898.378814:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523504949952:192.168.201.123@tcp:400:kworker.0 00010000:00010000:1.0F:1715206898.514828:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:1.0:1715206898.882438:0:8523:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=20800f0 00800000:00000080:1.0:1715206898.882454:0:8523:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800aa4c6880 uarg=0000000000000000 00000002:00000080:1.0:1715206898.882462:0:8523:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800aa4c6880 uarg=0000000000000000 00000100:00100000:1.0:1715206898.882507:0:8523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9678000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8523:1798523504950080:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1715206898.882593:0:8523:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9056840 going to sleep for 11 seconds 00000100:00100000:1.0:1715206898.884052:0:8523:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8523:1798523504950080:192.168.201.123@tcp:60:lhsmtool_posix.0 00000002:00000080:1.0:1715206898.884064:0:8523:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800aa4c6880 uarg=0000000000000000 00000100:00100000:1.0:1715206898.884078:0:8523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9678000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8523:1798523504950144:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1715206898.884099:0:8523:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9056840 going to sleep for 11 seconds 00000100:00100000:1.0:1715206898.884853:0:8523:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8523:1798523504950144:192.168.201.123@tcp:60:lhsmtool_posix.0 00000080:00200008:1.0:1715206898.884883:0:8523:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:1.0:1715206898.884909:0:8523:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff8800a967aa00 x1798523504936384/t4294967396(4294967396) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206843 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:1.0:1715206898.884925:0:8523:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1715206898.884929:0:8523:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9678000 x1798523504950272/t0(0) o35->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715206898.884939:0:8523:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9678000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8523:1798523504950272:192.168.201.123@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1715206898.884961:0:8523:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9056840 going to sleep for 11 seconds 00000100:00100000:1.0:1715206898.886518:0:8523:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:8523:1798523504950272:192.168.201.123@tcp:35:lhsmtool_posix.0 00000002:00100000:1.0:1715206898.886533:0:8523:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a967aa00 x1798523504936384/t4294967396(4294967396) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206843 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:1.0:1715206898.886554:0:8523:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200008:0.0F:1715206898.888609:0:8523:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00010000:00010000:1.0:1715206899.516868:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206900.518791:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206901.520741:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715206901.645600:0:11143:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12g: Restore a released file implicitly ========================================================== 18:21:41 (1715206901) 00000080:00200008:1.0:1715206901.765139:0:11186:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715206901.765149:0:11186:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715206901.765170:0:11186:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206901.765186:0:11186:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206901.765200:0:11186:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206901.765211:0:11186:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715206901.765214:0:11186:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:1.0:1715206901.765221:0:11186:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a90f7cc8 00010000:00010000:1.0:1715206901.765226:0:11186:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206901.765234:0:11186:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1715206901.765688:0:11186:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715206901.765693:0:11186:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206901.765705:0:11186:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206901.765746:0:11186:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765754:0:11186:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765773:0:11186:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11186 initiator: MDT0 00000100:00100000:1.0:1715206901.765789:0:11186:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9056240 going to sleep for 0 seconds 00000100:00100000:1.0:1715206901.765800:0:11186:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:04532c2b-e5e9-420d-abb0-4480aab1e378:11186:1798523504950336:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715206901.765809:0:11186:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765816:0:11186:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765821:0:11186:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765826:0:11186:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765832:0:11186:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765838:0:11186:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa66a400 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206901.765842:0:11186:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765847:0:11186:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765853:0:11186:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765858:0:11186:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206901.765864:0:11186:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 11186 initiator: MDT0 00010000:00010000:1.0:1715206901.765873:0:11186:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fe9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 11186 initiator: MDT0 00000080:00020000:1.0:1715206901.765892:0:11186:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715206901.774054:0:11186:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715206901.774063:0:11186:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715206901.774078:0:11186:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206901.774090:0:11186:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206901.774105:0:11186:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206901.774119:0:11186:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715206901.774123:0:11186:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:1.0:1715206901.774129:0:11186:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a90f7cc8 00010000:00010000:1.0:1715206901.774134:0:11186:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206901.774146:0:11186:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715206901.774266:0:11186:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715206901.774306:0:11186:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206901.774319:0:11186:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206901.774333:0:11186:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715206901.774355:0:11186:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715206901.774359:0:11186:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:1.0:1715206901.774366:0:11186:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a90f7b80 00010000:00010000:1.0:1715206901.774372:0:11186:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206901.774384:0:11186:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715206901.774399:0:11186:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715206901.774409:0:11186:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:3.0:1715206901.775379:0:11187:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715206901.775395:0:11187:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206901.775405:0:11187:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206901.775417:0:11187:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206901.775427:0:11187:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715206901.775430:0:11187:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:3.0:1715206901.775434:0:11187:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a960bb80 00010000:00010000:3.0:1715206901.775438:0:11187:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206901.775446:0:11187:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206901.775455:0:11187:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715206901.775466:0:11187:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:3.0:1715206901.775491:0:11187:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715206901.775498:0:11187:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206901.775504:0:11187:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206901.775512:0:11187:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206901.775520:0:11187:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715206901.775522:0:11187:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:3.0:1715206901.775525:0:11187:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a960bbb0 00010000:00010000:3.0:1715206901.775527:0:11187:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206901.775534:0:11187:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206901.775558:0:11187:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715206901.775563:0:11187:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:3.0:1715206901.775568:0:11187:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff880136f410c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715206901.775610:0:11187:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), file ffff8801368ecf00, open_flags 8000, mode 0 opened 0 00000080:00200000:3.0:1715206901.775618:0:11187:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), intent=open 00000002:00010000:3.0:1715206901.775629:0:11187:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:3.0:1715206901.775664:0:11187:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 11187 initiator: MDT0 00010000:00010000:3.0:1715206901.775671:0:11187:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 11187 initiator: MDT0 00000020:00100000:3.0:1715206901.775693:0:11187:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1715206901.775703:0:11187:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012a410380 x1798523504950464/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1715206901.775714:0:11187:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 11187 initiator: MDT0 00000100:00100000:3.0:1715206901.775730:0:11187:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a410380 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:11187:1798523504950464:192.168.201.123@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1715206901.775923:0:11187:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801373690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715206901.778326:0:11187:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a410380 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:11187:1798523504950464:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715206901.778339:0:11187:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 11187 initiator: MDT0 00010000:00010000:2.0:1715206901.778348:0:11187:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 11187 initiator: MDT0 00010000:00010000:2.0:1715206901.778354:0:11187:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 11187 initiator: MDT0 00010000:00010000:2.0:1715206901.778359:0:11187:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 11187 initiator: MDT0 00010000:00010000:2.0:1715206901.778364:0:11187:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 11187 initiator: MDT0 00010000:00010000:2.0:1715206901.778378:0:11187:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa549f80 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:2.0:1715206901.778381:0:11187:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 11187 initiator: MDT0 00010000:00010000:2.0:1715206901.778385:0:11187:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 11187 initiator: MDT0 00010000:00010000:2.0:1715206901.778390:0:11187:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 11187 initiator: MDT0 00010000:00010000:2.0:1715206901.778395:0:11187:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206901.778398:0:11187:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 11187 initiator: MDT0 00010000:00010000:2.0:1715206901.778403:0:11187:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa549f80/0x7561918bd556fea5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 11187 initiator: MDT0 00000002:00100000:2.0:1715206901.778415:0:11187:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012a410380 x1798523504950464/t4294967398(4294967398) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206917 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:2.0:1715206901.778427:0:11187:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a410380 x1798523504950464/t4294967398(4294967398) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206917 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715206901.778447:0:11187:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 4096 00000080:00200000:2.0:1715206901.778449:0:11187:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b02788c8): rc = 0 00000080:00010000:2.0:1715206901.778453:0:11187:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b02788c8) for lock 0x0 00000080:00200008:2.0:1715206901.778466:0:11187:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:2.0:1715206901.778478:0:11187:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a410380 x1798523504950464/t4294967398(4294967398) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206917 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715206901.778527:0:11187:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b02788c8), inode mode 4040 mask 44 00000080:00200080:2.0:1715206901.778602:0:11187:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=aa20f0 00800000:00000080:2.0:1715206901.778616:0:11187:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b3a4cb00 uarg=0000000000000000 00000002:00000080:2.0:1715206901.778624:0:11187:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b3a4cb00 uarg=0000000000000000 00000100:00100000:2.0:1715206901.778647:0:11187:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:11187:1798523504950528:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715206901.778691:0:11187:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1715206901.780216:0:11187:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:11187:1798523504950528:192.168.201.123@tcp:59:lhsmtool_posix.0 00000002:00000080:2.0:1715206901.780235:0:11187:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b3a4cb00 uarg=0000000000000000 00000100:00100000:2.0:1715206901.780263:0:11187:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:11187:1798523504950592:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715206901.780340:0:11187:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1715206901.781735:0:11187:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:11187:1798523504950592:192.168.201.123@tcp:59:lhsmtool_posix.0 00000080:00200000:3.0:1715206901.783618:0:11188:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715206901.783632:0:11188:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206901.783660:0:11188:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783669:0:11188:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783677:0:11188:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11188 initiator: MDT0 00000100:00100000:3.0:1715206901.783687:0:11188:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801373696c0 going to sleep for 0 seconds 00000100:00100000:3.0:1715206901.783693:0:11188:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a413b80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:11188:1798523504950656:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715206901.783701:0:11188:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783707:0:11188:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783713:0:11188:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783727:0:11188:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783733:0:11188:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783738:0:11188:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa54a880 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715206901.783741:0:11188:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783746:0:11188:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783751:0:11188:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783755:0:11188:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206901.783759:0:11188:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783763:0:11188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a880/0x7561918bd556feac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 11188 initiator: MDT0 00000080:00020000:3.0:1715206901.783780:0:11188:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715206901.783802:0:11188:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715206901.783809:0:11188:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206901.783826:0:11188:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783832:0:11188:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783838:0:11188:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11188 initiator: MDT0 00000100:00100000:3.0:1715206901.783850:0:11188:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801373696c0 going to sleep for 0 seconds 00000100:00100000:3.0:1715206901.783855:0:11188:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a413b80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:11188:1798523504950720:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715206901.783862:0:11188:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783868:0:11188:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783873:0:11188:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783878:0:11188:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783883:0:11188:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783887:0:11188:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa54a640 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715206901.783890:0:11188:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783894:0:11188:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783899:0:11188:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783903:0:11188:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206901.783906:0:11188:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783910:0:11188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa54a640/0x7561918bd556feb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 11188 initiator: MDT0 00000080:00020000:3.0:1715206901.783928:0:11188:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715206901.783942:0:11188:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206901.783946:0:11188:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715206901.783952:0:11188:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206901.783966:0:11188:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783972:0:11188:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783977:0:11188:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11188 initiator: MDT0 00000100:00100000:3.0:1715206901.783984:0:11188:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801373696c0 going to sleep for 0 seconds 00000100:00100000:3.0:1715206901.783988:0:11188:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a413b80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:11188:1798523504950784:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715206901.783994:0:11188:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.783999:0:11188:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.784004:0:11188:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.784008:0:11188:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.784013:0:11188:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.784017:0:11188:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa549d40 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715206901.784025:0:11188:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.784030:0:11188:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.784034:0:11188:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.784039:0:11188:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206901.784041:0:11188:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 11188 initiator: MDT0 00010000:00010000:3.0:1715206901.784046:0:11188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556feba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 11188 initiator: MDT0 00000080:00020000:3.0:1715206901.784058:0:11188:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715206901.786471:0:11189:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715206901.786506:0:11189:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206901.786532:0:11189:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786543:0:11189:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786553:0:11189:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11189 initiator: MDT0 00000100:00100000:3.0:1715206901.786563:0:11189:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801373696c0 going to sleep for 0 seconds 00000100:00100000:3.0:1715206901.786570:0:11189:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a413b80 pname:cluuid:pid:xid:nid:opc:job bash:04532c2b-e5e9-420d-abb0-4480aab1e378:11189:1798523504950848:192.168.201.123@tcp:101:bash.0 00010000:00010000:3.0:1715206901.786579:0:11189:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786584:0:11189:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786622:0:11189:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786628:0:11189:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786633:0:11189:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786637:0:11189:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa549b00 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715206901.786640:0:11189:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786645:0:11189:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786667:0:11189:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786673:0:11189:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206901.786677:0:11189:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 11189 initiator: MDT0 00010000:00010000:3.0:1715206901.786683:0:11189:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549b00/0x7561918bd556fec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 11189 initiator: MDT0 00000080:00020000:3.0:1715206901.786703:0:11189:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715206901.789197:0:11190:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715206901.789210:0:11190:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206901.789219:0:11190:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206901.789238:0:11190:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206901.789246:0:11190:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715206901.789249:0:11190:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:3.0:1715206901.789253:0:11190:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a916faf8 00010000:00010000:3.0:1715206901.789257:0:11190:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206901.789264:0:11190:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206901.789274:0:11190:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715206901.789303:0:11190:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=d12g.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8), flags=16 00000080:00200000:3.0:1715206901.789308:0:11190:0:(namei.c:838:ll_lookup_it()) VFS Op:name=d12g.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8), intent=0 00000002:00010000:3.0:1715206901.789317:0:11190:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: d12g.sanity-hsm,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1715206901.789338:0:11190:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.789344:0:11190:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.789350:0:11190:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 11190 initiator: MDT0 00000100:00100000:3.0:1715206901.789363:0:11190:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a413b80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:11190:1798523504950912:192.168.201.123@tcp:101:rm.0 00000100:00100000:3.0:1715206901.789408:0:11190:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801373696c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206901.791233:0:11190:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a413b80 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:11190:1798523504950912:192.168.201.123@tcp:101:rm.0 00010000:00010000:3.0:1715206901.791255:0:11190:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.791267:0:11190:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.791276:0:11190:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.791310:0:11190:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.791319:0:11190:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.791327:0:11190:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa548d80 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715206901.791331:0:11190:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.791340:0:11190:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.791348:0:11190:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.791356:0:11190:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206901.791361:0:11190:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 11190 initiator: MDT0 00010000:00010000:3.0:1715206901.791370:0:11190:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa548d80/0x7561918bd556fec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 11190 initiator: MDT0 00000002:00100000:3.0:1715206901.791388:0:11190:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=10 disposition=7, status=0 req@ffff88012a413b80 x1798523504950912/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 584/584 e 0 to 0 dl 1715206917 ref 1 fl Complete:RQU/200/0 rc 301/301 job:'rm.0' uid:0 gid:0 00010000:00010000:3.0:1715206901.791424:0:11190:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206901.791433:0:11190:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206901.791440:0:11190:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a916f930 00010000:00010000:3.0:1715206901.791443:0:11190:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206901.791450:0:11190:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206901.791508:0:11190:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715206901.791517:0:11190:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206901.791523:0:11190:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206901.791529:0:11190:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206901.791536:0:11190:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715206901.791539:0:11190:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:3.0:1715206901.791542:0:11190:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a916fb90 00010000:00010000:3.0:1715206901.791545:0:11190:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206901.791551:0:11190:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206901.791598:0:11190:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715206901.791605:0:11190:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d12g.sanity-hsm, flags=16 00000080:00200000:2.0:1715206901.795445:0:11191:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:2.0:1715206901.795457:0:11191:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206901.795466:0:11191:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206901.795476:0:11191:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715206901.795483:0:11191:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:2.0:1715206901.795486:0:11191:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:2.0:1715206901.795490:0:11191:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a90f7af8 00010000:00010000:2.0:1715206901.795493:0:11191:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206901.795499:0:11191:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1715206901.795517:0:11191:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:2.0:1715206901.795522:0:11191:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d12g.sanity-hsm, flags=17 00000080:00200000:2.0:1715206901.795544:0:11191:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:2.0:1715206901.795550:0:11191:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206901.795555:0:11191:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206901.795593:0:11191:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715206901.795604:0:11191:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:2.0:1715206901.795608:0:11191:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:2.0:1715206901.795613:0:11191:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a90f7af8 00010000:00010000:2.0:1715206901.795617:0:11191:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206901.795627:0:11191:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1715206901.795639:0:11191:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:2.0:1715206901.795645:0:11191:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d12g.sanity-hsm, flags=17 00000080:00200000:2.0:1715206901.795684:0:11191:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:2.0:1715206901.795691:0:11191:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206901.795697:0:11191:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206901.795704:0:11191:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715206901.795721:0:11191:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:2.0:1715206901.795723:0:11191:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd556fafb 00000080:00010000:2.0:1715206901.795727:0:11191:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd556fafb from it ffff8800a90f7bb0 00010000:00010000:2.0:1715206901.795729:0:11191:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206901.795735:0:11191:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b3c0/0x7561918bd556fafb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed878917bb expref: -99 pid: 20655 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1715206901.795743:0:11191:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:2.0:1715206901.795746:0:11191:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d12g.sanity-hsm, flags=17 00000001:02000400:1.0:1715206902.325438:0:11327:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12g: @@@@@@ FAIL: cannot create /mnt/lustre2/d12g.sanity-hsm/f12g.sanity-hsm with cp, status=1 00010000:00010000:0.0:1715206902.522671:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 321 lines, 321 kept, 0 dropped, 0 bad.