00010000:00010000:2.0F:1787096501.204920:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0F:1787096501.458543:0:23871:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:1.0:1787096501.458567:0:23871:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096501.458617:0:23871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 23871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096501.458627:0:23871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 23871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096501.458637:0:23871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 23871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096501.458662:0:23871:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d8544a80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:23871:1873906345475840:192.168.203.145@tcp:101:rm.0 00000100:00100000:1.0:1787096501.458868:0:23871:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c8866300 going to sleep for 11 seconds 00000100:00100000:2.0:1787096501.461057:0:23871:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d8544a80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:23871:1873906345475840:192.168.203.145@tcp:101:rm.0 00010000:00010000:2.0:1787096501.461077:0:23871:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.461089:0:23871:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.461099:0:23871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.461106:0:23871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.461114:0:23871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.461119:0:23871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.461125:0:23871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096501.461144:0:23871:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25d8544a80 x1873906345475840/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096517 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096501.461157:0:23871:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.461168:0:23871:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1787096501.461181:0:23871:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787096501.461217:0:23871:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:2.0:1787096501.461223:0:23871:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8345 00000080:00010000:2.0:1787096501.461228:0:23871:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096501.461232:0:23871:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8345 from it ffffa5c141a4bb58 00010000:00010000:2.0:1787096501.461246:0:23871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.461255:0:23871:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096501.461279:0:23871:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096501.461293:0:23871:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), flags=8 00000080:00200000:2.0:1787096501.461296:0:23871:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=getattr 00000002:00010000:2.0:1787096501.461312:0:23871:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5a.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096501.461350:0:23871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 23871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.461358:0:23871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.461367:0:23871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 23871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096501.461384:0:23871:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887b800 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:23871:1873906345475968:192.168.203.145@tcp:101:rm.0 00000100:00100000:2.0:1787096501.461447:0:23871:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c58edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096501.463067:0:23871:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887b800 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:23871:1873906345475968:192.168.203.145@tcp:101:rm.0 00010000:00010000:2.0:1787096501.463084:0:23871:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.463108:0:23871:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.463115:0:23871:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.463124:0:23871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.463134:0:23871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.463145:0:23871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.463152:0:23871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.463159:0:23871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096501.463170:0:23871:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25c887b800 x1873906345475968/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096517 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096501.463181:0:23871:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.463190:0:23871:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589935617/11 (0 0) 00000080:00200000:2.0:1787096501.463202:0:23871:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787096501.463217:0:23871:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0xb:0x0], updating i_size 0 00000080:00200000:2.0:1787096501.463220:0:23871:0:(namei.c:147:ll_iget()) got inode: [0x200000401:0xb:0x0](ffff8d25c8d1ba88): rc = 0 00000080:00200000:2.0:1787096501.463257:0:23871:0:(file.c:6803:ll_layout_conf()) [0x200000401:0xb:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787096501.463282:0:23871:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xb:0x0](ffff8d25c8d1ba88) for lock 0x93bbba3c5a0d834c 00000080:00010000:2.0:1787096501.463291:0:23871:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xb:0x0](ffff8d25c8d1ba88) 00000080:00010000:2.0:1787096501.463295:0:23871:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d834c from it ffffa5c141a4bb20 00010000:00010000:2.0:1787096501.463298:0:23871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096501.463307:0:23871:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1787096501.463330:0:23871:0:(file.c:6271:ll_getattr_dentry()) START file f5a.sanity-ec:[0x200000401:0xb:0x0](ffff8d25c8d1ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787096501.463336:0:23871:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0xb:0x0](ffff8d25c8d1ba88),name=f5a.sanity-ec 00000002:00010000:2.0:1787096501.463348:0:23871:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0xb:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096501.463355:0:23871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096501.463365:0:23871:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096501.463372:0:23871:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096501.463376:0:23871:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xb:0x0](ffff8d25c8d1ba88) 00000080:00010000:2.0:1787096501.463379:0:23871:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xb:0x0](ffff8d25c8d1ba88) for lock 0x93bbba3c5a0d834c 00000080:00010000:2.0:1787096501.463382:0:23871:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d834c from it ffffa5c141a4bcb8 00010000:00010000:2.0:1787096501.463385:0:23871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096501.463403:0:23871:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096501.463446:0:23871:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096501.463453:0:23871:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096501.463461:0:23871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096501.463469:0:23871:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096501.463475:0:23871:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096501.463480:0:23871:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096501.463482:0:23871:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8345 00000080:00010000:2.0:1787096501.463486:0:23871:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8345 from it ffffa5c141a4bc10 00010000:00010000:2.0:1787096501.463552:0:23871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096501.463561:0:23871:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096501.463569:0:23871:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096501.463576:0:23871:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f5a.sanity-ec, flags=0 00000080:00200000:2.0:1787096501.463581:0:23871:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096501.463587:0:23871:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096501.463592:0:23871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096501.463617:0:23871:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096501.463623:0:23871:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096501.463628:0:23871:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096501.463631:0:23871:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8345 00000080:00010000:2.0:1787096501.463635:0:23871:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8345 from it ffffa5c141a4bd68 00010000:00010000:2.0:1787096501.463637:0:23871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096501.463644:0:23871:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787096501.463652:0:23871:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 3 00000080:00200000:2.0:1787096501.463657:0:23871:0:(namei.c:2404:ll_unlink()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00010000:00010000:2.0:1787096501.463697:0:23871:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096501.463717:0:23871:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096501.463755:0:23871:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xb:0x0]: losing layout lock 00010000:00010000:2.0:1787096501.463805:0:23871:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 1/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096501.463813:0:23871:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096501.463830:0:23871:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1787096501.463833:0:23871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d834c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xdf123ee4d633457 expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096501.463851:0:23871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308800/0x93bbba3c5a0d8345 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d63343b expref: -99 pid: 23871 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:2.0:1787096501.463869:0:23871:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787096501.463876:0:23871:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c887b800 x1873906345476224/t0(0) o36->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096501.463907:0:23871:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887b800 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:23871:1873906345476224:192.168.203.145@tcp:36:rm.0 00000100:00100000:2.0:1787096501.463970:0:23871:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c58edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096501.466265:0:23871:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887b800 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:23871:1873906345476224:192.168.203.145@tcp:36:rm.0 00000080:00200000:2.0:1787096501.466321:0:23871:0:(vvp_io.c:1944:vvp_io_init()) [0x200000401:0xb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787096501.466329:0:23871:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787096501.466345:0:23871:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000401:0xb:0x0](ffff8d25c8d1ba88) 00010000:00010000:2.0:1787096502.229809:0:5561:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1787096502.420963:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6:2358:1873906345476352:192.168.203.145@tcp:400:kworker.0 00000100:00100000:3.0:1787096502.421147:0:2358:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787096502.421156:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345476480:192.168.203.145@tcp:400:kworker.0 00000100:00100000:3.0:1787096502.422263:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345476480:192.168.203.145@tcp:400:kworker.0 00000100:00100000:3.0:1787096502.422273:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6:2358:1873906345476352:192.168.203.145@tcp:400:kworker.0 00010000:00010000:3.0:1787096503.254013:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096504.131457:0:24149:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 5b: EC FLR state transitions with writes to different components ========================================================== 19:41:43 (1787096503) 00000080:00200000:1.0:1787096504.188150:0:24165:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:1.0:1787096504.188172:0:24165:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096504.188227:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.188237:0:24165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.188246:0:24165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096504.188269:0:24165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d8545c00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:24165:1873906345476608:192.168.203.145@tcp:101:lfs.0 00000100:00100000:1.0:1787096504.188351:0:24165:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c8866d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787096504.190869:0:24165:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8d25d82bf800: committing for last_committed 4294967335 gen 1 00000100:00100000:1.0:1787096504.190927:0:24165:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d8545c00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:24165:1873906345476608:192.168.203.145@tcp:101:lfs.0 00010000:00010000:1.0:1787096504.190946:0:24165:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.190967:0:24165:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.190980:0:24165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.190991:0:24165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.191002:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.191010:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.191017:0:24165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787096504.191028:0:24165:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25d8545c00 x1873906345476608/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096520 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787096504.191042:0:24165:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.191054:0:24165:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1787096504.191060:0:24165:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787096504.191081:0:24165:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:1.0:1787096504.191092:0:24165:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8353 00000080:00010000:1.0:1787096504.191098:0:24165:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:1.0:1787096504.191101:0:24165:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8353 from it ffffa5c141813b58 00010000:00010000:1.0:1787096504.191105:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.191114:0:24165:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787096504.191131:0:24165:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:1.0:1787096504.191142:0:24165:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), flags=8 00000080:00200000:1.0:1787096504.191147:0:24165:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=getattr 00000002:00010000:1.0:1787096504.191163:0:24165:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5b.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787096504.191192:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.191199:0:24165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096504.191206:0:24165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096504.191222:0:24165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25d8545c00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:24165:1873906345476736:192.168.203.145@tcp:101:lfs.0 00000100:00100000:1.0:1787096504.191280:0:24165:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c8866d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787096504.193535:0:24165:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25d8545c00 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:24165:1873906345476736:192.168.203.145@tcp:101:lfs.0 00010000:00010000:3.0:1787096504.193552:0:24165:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.193565:0:24165:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.193572:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.193579:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.193587:0:24165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.193594:0:24165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d25ca309200 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:3.0:1787096504.193598:0:24165:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.193605:0:24165:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.193624:0:24165:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.193632:0:24165:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787096504.193640:0:24165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.193647:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309200/0x93bbba3c5a0d835a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096504.193665:0:24165:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8d25d8545c00 x1873906345476736/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096520 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787096504.193678:0:24165:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787096504.193697:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096504.193710:0:24165:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787096504.193719:0:24165:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8353 from it ffffa5c141813930 00010000:00010000:3.0:1787096504.193746:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096504.193755:0:24165:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096504.193814:0:24165:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:3.0:1787096504.193826:0:24165:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096504.193839:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096504.193849:0:24165:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096504.193856:0:24165:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096504.193863:0:24165:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:3.0:1787096504.193867:0:24165:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8353 00000080:00010000:3.0:1787096504.193886:0:24165:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8353 from it ffffa5c141813bf8 00010000:00010000:3.0:1787096504.193891:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096504.193899:0:24165:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096504.193911:0:24165:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:3.0:1787096504.193920:0:24165:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f5b.sanity-ec, flags=777 00000080:00200000:3.0:1787096504.193925:0:24165:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:3.0:1787096504.193932:0:24165:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096504.193938:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096504.193947:0:24165:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096504.193954:0:24165:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096504.193958:0:24165:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:3.0:1787096504.193961:0:24165:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8353 00000080:00010000:3.0:1787096504.193971:0:24165:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8353 from it ffffa5c141813b38 00010000:00010000:3.0:1787096504.193975:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096504.193983:0:24165:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787096504.193993:0:24165:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 3 00000080:00200000:3.0:1787096504.193999:0:24165:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), file ffff8d25d9864300, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787096504.194008:0:24165:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=open|creat 00000002:00010000:3.0:1787096504.194025:0:24165:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5b.sanity-ec,[0x200000401:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787096504.194035:0:24165:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096504.194069:0:24165:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096504.194076:0:24165:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096504.194079:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca308600/0x93bbba3c5a0d8353 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d633481 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787096504.194121:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.194128:0:24165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787096504.194137:0:24165:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787096504.194144:0:24165:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c58f4700 x1873906345476992/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787096504.194158:0:24165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096504.194174:0:24165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f4700 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:24165:1873906345476992:192.168.203.145@tcp:101:lfs.0 00000100:00100000:3.0:1787096504.194435:0:24165:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c5186cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096504.198833:0:24165:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f4700 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:24165:1873906345476992:192.168.203.145@tcp:101:lfs.0 00010000:00010000:3.0:1787096504.198855:0:24165:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.198893:0:24165:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 4/0,1 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.198902:0:24165:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 4/0,1 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.198913:0:24165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.198924:0:24165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.198936:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.198942:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.198955:0:24165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096504.198963:0:24165:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8d25c58f4700 x1873906345476992/t4294967336(4294967336) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096520 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787096504.198972:0:24165:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8d25c58f4700 x1873906345476992/t4294967336(4294967336) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096520 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787096504.198980:0:24165:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.198988:0:24165:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589935617/12 (0 0) 00000080:00200000:3.0:1787096504.198992:0:24165:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787096504.199002:0:24165:0:(namei.c:1619:ll_create_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=open|creat 00000080:00200000:3.0:1787096504.199026:0:24165:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8d25c8d1d348) 00000080:00200000:3.0:1787096504.199031:0:24165:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0xc:0x0], updating i_size 0 00000080:00200000:3.0:1787096504.199127:0:24165:0:(file.c:6803:ll_layout_conf()) [0x200000401:0xc:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787096504.199139:0:24165:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000401:0xc:0x0](ffff8d25c8d1d348) 00000080:00010000:3.0:1787096504.199142:0:24165:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xc:0x0](ffff8d25c8d1d348) for lock 0x93bbba3c5a0d8361 00000080:00010000:3.0:1787096504.199151:0:24165:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xc:0x0](ffff8d25c8d1d348) 00000080:00200008:3.0:1787096504.199163:0:24165:0:(file.c:1058:ll_file_open()) START file f5b.sanity-ec:[0x200000401:0xc:0x0](ffff8d25c8d1d348), flags 120501 00000002:00100000:3.0:1787096504.199187:0:24165:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8d25c58f4700 x1873906345476992/t4294967336(4294967336) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096520 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787096504.199213:0:24165:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8361 from it ffff8d25c889fea0 00010000:00010000:3.0:1787096504.199216:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.199234:0:24165:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096504.199248:0:24165:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8d25c8d1d348), inode mode 81a4 mask 40 00000080:00200000:3.0:1787096504.199290:0:24165:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8d25c8d1d348), inode mode 81a4 mask 2 00000080:00200000:3.0:1787096504.199300:0:24165:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000401:0xc:0x0](ffff8d25c8d1d348), xattr lov 00000002:00010000:3.0:1787096504.199315:0:24165:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787096504.199355:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.199363:0:24165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787096504.199373:0:24165:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787096504.199379:0:24165:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c58f7100 x1873906345477248/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 1032/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787096504.199392:0:24165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096504.199417:0:24165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f7100 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:24165:1873906345477248:192.168.203.145@tcp:101:lfs.0 00000100:00100000:3.0:1787096504.199551:0:24165:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c5186cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096504.203266:0:2347:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.145@tcp (source: 12345-192.168.203.145@tcp) 00000100:00100000:1.0:1787096504.203298:0:5552:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787096504.203311:0:5552:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353884928 00000100:00100000:1.0:1787096504.203318:0:5552:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353884928 00000100:00100000:1.0:1787096504.203355:0:5552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.145@tcp, seq: 13 00000100:00100000:1.0:1787096504.203370:0:5552:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8d25d857a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:5764:x1873906353884928:12345-192.168.203.145@tcp:104: 00010000:00010000:1.0:1787096504.203384:0:5552:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096504.203444:0:5552:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787096504.203450:0:5552:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8d25d857a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:5764:x1873906353884928:12345-192.168.203.145@tcp:104: Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096504.203457:0:5552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.145@tcp, seq: 13 00010000:00010000:2.0:1787096504.203461:0:6019:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096504.203467:0:6019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096504.203474:0:6019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d260217f800 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:2.0:1787096504.203478:0:6019:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096504.203492:0:6019:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096504.203502:0:6019:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096504.203546:0:6019:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xc:0x0]: losing layout lock 00010000:00010000:2.0:1787096504.203588:0:6019:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096504.203593:0:6019:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096504.203614:0:6019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096504.203623:0:6019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217f800/0x93bbba3c5a0d8361 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d6334b2 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096504.203636:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096504.203638:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096504.203639:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096504.203674:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345477376:192.168.203.145@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787096504.204987:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345477376:192.168.203.145@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787096504.205678:0:24165:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f7100 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:24165:1873906345477248:192.168.203.145@tcp:101:lfs.0 00010000:00010000:3.0:1787096504.205694:0:24165:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.205712:0:24165:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.205718:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.205742:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.205749:0:24165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.205755:0:24165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d260217e200 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:3.0:1787096504.205758:0:24165:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.205772:0:24165:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.205779:0:24165:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.205786:0:24165:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787096504.205791:0:24165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096504.205799:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217e200/0x93bbba3c5a0d8368 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 24165 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096504.205821:0:24165:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8d25c58f7100 x1873906345477248/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 1032/608 e 0 to 0 dl 1787096520 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787096504.205845:0:24165:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:3.0:1787096504.205852:0:24165:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:3.0:1787096504.206007:0:24165:0:(file.c:448:ll_file_release()) START file f5b.sanity-ec:[0x200000401:0xc:0x0](ffff8d25c8d1d348), flags 100001 00000002:00100000:3.0:1787096504.206041:0:24165:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8d25c58f4700 x1873906345476992/t4294967336(4294967336) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096520 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787096504.206049:0:24165:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787096504.206053:0:24165:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c58f7100 x1873906345477632/t0(0) o35->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787096504.206065:0:24165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f7100 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:24165:1873906345477632:192.168.203.145@tcp:35:lfs.0 00000100:00100000:3.0:1787096504.206109:0:24165:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c5186cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096504.207199:0:24165:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f7100 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:24165:1873906345477632:192.168.203.145@tcp:35:lfs.0 00000002:00100000:3.0:1787096504.207215:0:24165:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8d25c58f4700 x1873906345476992/t4294967336(4294967336) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096520 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787096504.277122:0:5561:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0F:1787096504.659516:0:24292:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_5b: @@@@@@ FAIL: setstripe failed Debug log: 296 lines, 296 kept, 0 dropped, 0 bad.