00000100:00080000:0.0F:1715208479.656675:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715208479.656687:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715208479.656701:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715208479.656704:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715208479.656717:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715208479.656720:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:0.0:1715208479.656755:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2001:1798523505095424:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715208479.656832:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505095552:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715208479.656851:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505095680:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715208479.656873:0:2001:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1715208479.656879:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2001:1798523505095488:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715208479.656894:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505095616:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715208479.658916:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2001:1798523505095488:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715208479.658929:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505095616:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715208479.658938:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2001:1798523505095424:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715208479.658946:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505095552:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715208479.658954:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523505095680:192.168.201.123@tcp:400:kworker.0 00010000:00010000:0.0:1715208479.674746:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:2.0F:1715208480.013637:0:20156:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=e140f0 00800000:00000080:2.0:1715208480.013668:0:20156:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b5fb7580 uarg=0000000000000000 00000002:00000080:2.0:1715208480.013680:0:20156:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b5fb7580 uarg=0000000000000000 00000100:00100000:2.0:1715208480.013742:0:20156:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:20156:1798523505095744:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715208480.013834:0:20156:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa4bc900 going to sleep for 11 seconds 00000100:00100000:2.0:1715208480.019889:0:20156:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:20156:1798523505095744:192.168.201.123@tcp:60:lhsmtool_posix.0 00000002:00000080:2.0:1715208480.019911:0:20156:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b5fb7580 uarg=0000000000000000 00000100:00100000:2.0:1715208480.019936:0:20156:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:20156:1798523505095808:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715208480.019988:0:20156:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa4bc900 going to sleep for 11 seconds 00000100:00100000:2.0:1715208480.024629:0:20156:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:20156:1798523505095808:192.168.201.123@tcp:60:lhsmtool_posix.0 00000080:00200008:2.0:1715208480.024683:0:20156:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:2.0:1715208480.024730:0:20156:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff8800a91e4000 x1798523505081344/t4294967478(4294967478) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208292 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:2.0:1715208480.024756:0:20156:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1715208480.024763:0:20156:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800abe2ea00 x1798523505095936/t0(0) o35->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715208480.024779:0:20156:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:20156:1798523505095936:192.168.201.123@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715208480.024834:0:20156:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa4bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1715208480.026496:0:20156:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:20156:1798523505095936:192.168.201.123@tcp:35:lhsmtool_posix.0 00000002:00100000:2.0:1715208480.026529:0:20156:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a91e4000 x1798523505081344/t4294967478(4294967478) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208292 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:2.0:1715208480.026621:0:20156:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200008:2.0:1715208480.030415:0:20156:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00010000:00010000:1.0F:1715208480.676829:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715208481.678749:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715208482.680775:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1715208482.748935:0:22299:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 26a: Remove Archive On Last Unlink (RAoLU) policy ========================================================== 18:48:02 (1715208482) 00000080:00200008:1.0:1715208483.191723:0:22353:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715208483.191734:0:22353:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208483.191758:0:22353:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208483.191779:0:22353:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.191796:0:22353:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208483.191808:0:22353:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208483.191811:0:22353:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55706d9 00000080:00010000:1.0:1715208483.191879:0:22353:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a98a3cc8 00010000:00010000:1.0:1715208483.191884:0:22353:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.191893:0:22353:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1715208483.192384:0:22353:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715208483.192390:0:22353:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715208483.192404:0:22353:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208483.192458:0:22353:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192466:0:22353:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192476:0:22353:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22353 initiator: MDT0 00000100:00100000:1.0:1715208483.192494:0:22353:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3911840 going to sleep for 0 seconds 00000100:00100000:1.0:1715208483.192512:0:22353:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9679c00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:04532c2b-e5e9-420d-abb0-4480aab1e378:22353:1798523505096000:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715208483.192524:0:22353:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192531:0:22353:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192537:0:22353:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192543:0:22353:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192550:0:22353:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192556:0:22353:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa66aac0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715208483.192589:0:22353:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192597:0:22353:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192604:0:22353:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192610:0:22353:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208483.192617:0:22353:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 22353 initiator: MDT0 00010000:00010000:1.0:1715208483.192623:0:22353:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66aac0/0x7561918bd557070a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 22353 initiator: MDT0 00000080:00020000:1.0:1715208483.192647:0:22353:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715208483.192673:0:22353:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715208483.192677:0:22353:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208483.192686:0:22353:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208483.192694:0:22353:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.192703:0:22353:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208483.192712:0:22353:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208483.192715:0:22353:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55706d9 00000080:00010000:1.0:1715208483.192719:0:22353:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a98a3cc8 00010000:00010000:1.0:1715208483.192722:0:22353:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.192729:0:22353:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208483.192817:0:22353:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208483.192827:0:22353:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208483.192834:0:22353:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.192842:0:22353:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208483.192850:0:22353:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208483.192853:0:22353:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55706d9 00000080:00010000:1.0:1715208483.192856:0:22353:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a98a3b80 00010000:00010000:1.0:1715208483.192864:0:22353:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.192872:0:22353:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208483.192881:0:22353:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715208483.192888:0:22353:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:3.0F:1715208483.193711:0:22354:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715208483.193731:0:22354:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208483.193743:0:22354:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208483.193755:0:22354:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208483.193765:0:22354:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715208483.193768:0:22354:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55706d9 00000080:00010000:3.0:1715208483.193773:0:22354:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a969fb80 00010000:00010000:3.0:1715208483.193776:0:22354:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208483.193784:0:22354:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208483.193795:0:22354:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715208483.193801:0:22354:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:3.0:1715208483.193828:0:22354:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715208483.193833:0:22354:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208483.193839:0:22354:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208483.193846:0:22354:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208483.193853:0:22354:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715208483.193855:0:22354:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55706d9 00000080:00010000:3.0:1715208483.193858:0:22354:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a969fbb0 00010000:00010000:3.0:1715208483.193867:0:22354:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208483.193874:0:22354:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208483.193882:0:22354:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208483.193888:0:22354:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:3.0:1715208483.193893:0:22354:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff880136f410c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208483.193900:0:22354:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), file ffff8800a9367c80, open_flags 8000, mode 0 opened 0 00000080:00200000:3.0:1715208483.193908:0:22354:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), intent=open 00000002:00010000:3.0:1715208483.193918:0:22354:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:3.0:1715208483.193952:0:22354:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 22354 initiator: MDT0 00010000:00010000:3.0:1715208483.193959:0:22354:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 22354 initiator: MDT0 00000020:00100000:3.0:1715208483.193969:0:22354:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1715208483.193980:0:22354:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a91e4e00 x1798523505096128/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1715208483.193991:0:22354:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 22354 initiator: MDT0 00000100:00100000:3.0:1715208483.194008:0:22354:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e4e00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:22354:1798523505096128:192.168.201.123@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1715208483.194163:0:22354:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a927e600 going to sleep for 11 seconds 00000100:00100000:3.0:1715208483.196320:0:22354:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e4e00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:22354:1798523505096128:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715208483.196336:0:22354:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 22354 initiator: MDT0 00010000:00010000:3.0:1715208483.196360:0:22354:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 22354 initiator: MDT0 00010000:00010000:3.0:1715208483.196367:0:22354:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 22354 initiator: MDT0 00010000:00010000:3.0:1715208483.196374:0:22354:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 22354 initiator: MDT0 00010000:00010000:3.0:1715208483.196380:0:22354:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 22354 initiator: MDT0 00010000:00010000:3.0:1715208483.196385:0:22354:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a960b600 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208483.196389:0:22354:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 22354 initiator: MDT0 00010000:00010000:3.0:1715208483.196395:0:22354:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 22354 initiator: MDT0 00010000:00010000:3.0:1715208483.196401:0:22354:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 22354 initiator: MDT0 00010000:00010000:3.0:1715208483.196406:0:22354:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208483.196410:0:22354:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 22354 initiator: MDT0 00010000:00010000:3.0:1715208483.196415:0:22354:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960b600/0x7561918bd5570711 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 22354 initiator: MDT0 00000002:00100000:3.0:1715208483.196453:0:22354:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800a91e4e00 x1798523505096128/t4294967482(4294967482) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208499 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:3.0:1715208483.196468:0:22354:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a91e4e00 x1798523505096128/t4294967482(4294967482) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208499 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:3.0:1715208483.196500:0:22354:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 4096 00000080:00200000:3.0:1715208483.196503:0:22354:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b02788c8): rc = 0 00000080:00010000:3.0:1715208483.196508:0:22354:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b02788c8) for lock 0x0 00000080:00200008:3.0:1715208483.196522:0:22354:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:3.0:1715208483.196536:0:22354:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a91e4e00 x1798523505096128/t4294967482(4294967482) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208499 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:3.0:1715208483.196616:0:22354:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b02788c8), inode mode 4040 mask 44 00000080:00200080:3.0:1715208483.196672:0:22354:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=e720f0 00800000:00000080:3.0:1715208483.196683:0:22354:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800a977eee0 uarg=0000000000000000 00000002:00000080:3.0:1715208483.196694:0:22354:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800a977eee0 uarg=0000000000000000 00000100:00100000:3.0:1715208483.196720:0:22354:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e7480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:22354:1798523505096192:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715208483.196759:0:22354:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a927e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715208483.198680:0:22354:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e7480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:22354:1798523505096192:192.168.201.123@tcp:59:lhsmtool_posix.0 00000002:00000080:3.0:1715208483.198699:0:22354:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800a977eee0 uarg=0000000000000000 00000100:00100000:3.0:1715208483.198725:0:22354:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e7480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:22354:1798523505096256:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715208483.198777:0:22354:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a927e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715208483.200266:0:22354:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e7480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:22354:1798523505096256:192.168.201.123@tcp:59:lhsmtool_posix.0 00000080:00200000:3.0:1715208483.202908:0:22355:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715208483.202924:0:22355:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208483.202953:0:22355:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.202963:0:22355:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.202971:0:22355:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22355 initiator: MDT0 00000100:00100000:3.0:1715208483.202988:0:22355:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a927ecc0 going to sleep for 0 seconds 00000100:00100000:3.0:1715208483.202996:0:22355:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6680 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:22355:1798523505096320:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715208483.203005:0:22355:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203012:0:22355:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203017:0:22355:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203024:0:22355:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203030:0:22355:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203035:0:22355:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a960b3c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208483.203039:0:22355:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203045:0:22355:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203051:0:22355:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203056:0:22355:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208483.203060:0:22355:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203066:0:22355:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a960b3c0/0x7561918bd5570718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 22355 initiator: MDT0 00000080:00020000:3.0:1715208483.203089:0:22355:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715208483.203113:0:22355:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715208483.203122:0:22355:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208483.203141:0:22355:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203147:0:22355:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203154:0:22355:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22355 initiator: MDT0 00000100:00100000:3.0:1715208483.203163:0:22355:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a927ecc0 going to sleep for 0 seconds 00000100:00100000:3.0:1715208483.203168:0:22355:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6680 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:22355:1798523505096384:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715208483.203175:0:22355:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203181:0:22355:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203186:0:22355:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203192:0:22355:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203198:0:22355:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203203:0:22355:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609d40 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208483.203206:0:22355:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203217:0:22355:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203223:0:22355:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203228:0:22355:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208483.203232:0:22355:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203237:0:22355:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609d40/0x7561918bd557071f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 22355 initiator: MDT0 00000080:00020000:3.0:1715208483.203252:0:22355:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715208483.203269:0:22355:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208483.203296:0:22355:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715208483.203303:0:22355:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208483.203322:0:22355:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203328:0:22355:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203335:0:22355:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22355 initiator: MDT0 00000100:00100000:3.0:1715208483.203344:0:22355:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a927ecc0 going to sleep for 0 seconds 00000100:00100000:3.0:1715208483.203350:0:22355:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6680 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:22355:1798523505096448:192.168.201.123@tcp:101:lfs.0 00010000:00010000:3.0:1715208483.203356:0:22355:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203362:0:22355:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203373:0:22355:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203379:0:22355:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203385:0:22355:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203390:0:22355:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609440 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208483.203393:0:22355:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203398:0:22355:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203403:0:22355:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203408:0:22355:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208483.203412:0:22355:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 22355 initiator: MDT0 00010000:00010000:3.0:1715208483.203417:0:22355:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd5570726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 22355 initiator: MDT0 00000080:00020000:3.0:1715208483.203432:0:22355:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715208483.206083:0:22356:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715208483.206100:0:22356:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208483.206129:0:22356:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206139:0:22356:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206147:0:22356:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22356 initiator: MDT0 00000100:00100000:1.0:1715208483.206158:0:22356:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3911540 going to sleep for 0 seconds 00000100:00100000:1.0:1715208483.206166:0:22356:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9679c00 pname:cluuid:pid:xid:nid:opc:job bash:04532c2b-e5e9-420d-abb0-4480aab1e378:22356:1798523505096512:192.168.201.123@tcp:101:bash.0 00010000:00010000:1.0:1715208483.206175:0:22356:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206181:0:22356:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206187:0:22356:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206193:0:22356:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206210:0:22356:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206215:0:22356:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa6698c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715208483.206219:0:22356:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206224:0:22356:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206230:0:22356:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206236:0:22356:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208483.206240:0:22356:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 22356 initiator: MDT0 00010000:00010000:1.0:1715208483.206245:0:22356:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa6698c0/0x7561918bd557072d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 22356 initiator: MDT0 00000080:00020000:1.0:1715208483.206265:0:22356:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715208483.209295:0:22357:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715208483.209311:0:22357:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208483.209323:0:22357:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208483.209347:0:22357:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208483.209358:0:22357:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715208483.209361:0:22357:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55706d9 00000080:00010000:3.0:1715208483.209366:0:22357:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a922baf8 00010000:00010000:3.0:1715208483.209370:0:22357:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208483.209378:0:22357:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208483.209388:0:22357:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208483.209397:0:22357:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=d26a.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8), flags=16 00000080:00200000:3.0:1715208483.209401:0:22357:0:(namei.c:838:ll_lookup_it()) VFS Op:name=d26a.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff8800b02580c8), intent=0 00000002:00010000:3.0:1715208483.209408:0:22357:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: d26a.sanity-hsm,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1715208483.209432:0:22357:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.209439:0:22357:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.209447:0:22357:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 22357 initiator: MDT0 00000100:00100000:3.0:1715208483.209462:0:22357:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e6680 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:22357:1798523505096576:192.168.201.123@tcp:101:rm.0 00000100:00100000:3.0:1715208483.209514:0:22357:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a927ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1715208483.211485:0:22357:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e6680 pname:cluuid:pid:xid:nid:opc:job rm:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:22357:1798523505096576:192.168.201.123@tcp:101:rm.0 00010000:00010000:3.0:1715208483.211509:0:22357:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.211520:0:22357:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.211526:0:22357:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.211533:0:22357:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.211539:0:22357:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.211544:0:22357:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609b00 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715208483.211548:0:22357:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.211554:0:22357:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.211588:0:22357:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.211595:0:22357:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208483.211599:0:22357:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 22357 initiator: MDT0 00010000:00010000:3.0:1715208483.211605:0:22357:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a9609b00/0x7561918bd5570734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 22357 initiator: MDT0 00000002:00100000:3.0:1715208483.211619:0:22357:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=10 disposition=7, status=0 req@ffff8800a91e6680 x1798523505096576/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 584/584 e 0 to 0 dl 1715208499 ref 1 fl Complete:RQU/200/0 rc 301/301 job:'rm.0' uid:0 gid:0 00010000:00010000:3.0:1715208483.211658:0:22357:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208483.211669:0:22357:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208483.211676:0:22357:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a922b930 00010000:00010000:3.0:1715208483.211680:0:22357:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208483.211688:0:22357:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208483.211758:0:22357:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715208483.211768:0:22357:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208483.211775:0:22357:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208483.211783:0:22357:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208483.211790:0:22357:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715208483.211794:0:22357:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55706d9 00000080:00010000:3.0:1715208483.211798:0:22357:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a922bb90 00010000:00010000:3.0:1715208483.211801:0:22357:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208483.211807:0:22357:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208483.211822:0:22357:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208483.211827:0:22357:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d26a.sanity-hsm, flags=16 00000080:00200000:1.0:1715208483.216208:0:22358:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208483.216223:0:22358:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208483.216234:0:22358:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.216246:0:22358:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208483.216256:0:22358:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208483.216259:0:22358:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55706d9 00000080:00010000:1.0:1715208483.216290:0:22358:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a92cfaf8 00010000:00010000:1.0:1715208483.216295:0:22358:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.216304:0:22358:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208483.216314:0:22358:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208483.216320:0:22358:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d26a.sanity-hsm, flags=17 00000080:00200000:1.0:1715208483.216350:0:22358:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208483.216358:0:22358:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208483.216366:0:22358:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.216374:0:22358:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208483.216382:0:22358:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208483.216384:0:22358:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55706d9 00000080:00010000:1.0:1715208483.216387:0:22358:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a92cfaf8 00010000:00010000:1.0:1715208483.216391:0:22358:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.216398:0:22358:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208483.216406:0:22358:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208483.216409:0:22358:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d26a.sanity-hsm, flags=17 00000080:00200000:1.0:1715208483.216439:0:22358:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:1.0:1715208483.216452:0:22358:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208483.216459:0:22358:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.216468:0:22358:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208483.216475:0:22358:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:1.0:1715208483.216478:0:22358:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd55706d9 00000080:00010000:1.0:1715208483.216481:0:22358:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd55706d9 from it ffff8800a92cfbb0 00010000:00010000:1.0:1715208483.216484:0:22358:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208483.216490:0:22358:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a960ad00/0x7561918bd55706d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed8789293b expref: -99 pid: 20162 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208483.216498:0:22358:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208483.216503:0:22358:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d26a.sanity-hsm, flags=17 00010000:00010000:0.0:1715208483.682778:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715208483.706430:0:22492:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_26a: @@@@@@ FAIL: cannot create /mnt/lustre2/d26a.sanity-hsm/f26a.sanity-hsm with cp, status=1 Debug log: 322 lines, 322 kept, 0 dropped, 0 bad.