00010000:00010000:0.0F:1787096588.245868:0:39592:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0F:1787096588.496759:0:40017:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096588.496787:0:40017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096588.496806:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00010000:00010000:2.0:1787096588.496821:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00000080:00200000:2.0:1787096588.496829:0:40017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096588.496837:0:40017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096588.496841:0:40017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8640 00000080:00010000:2.0:1787096588.496847:0:40017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8640 from it ffffa5c141613b58 00010000:00010000:2.0:1787096588.496851:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 27 lru_type: 1 00010000:00010000:2.0:1787096588.496861:0:40017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00000080:00200000:2.0:1787096588.496877:0:40017:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096588.496886:0:40017:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d27a.sanity-ec, flags=8 00000080:00200008:2.0:1787096588.496896:0:40017:0:(file.c:6271:ll_getattr_dentry()) START file d27a.sanity-ec:[0x200000401:0x20:0x0](ffff8d25c8d8aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787096588.496902:0:40017:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08),name=d27a.sanity-ec 00000002:00010000:2.0:1787096588.496913:0:40017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x20:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096588.496920:0:40017:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 30 res 8589935617/32 (0 0) 00010000:00010000:2.0:1787096588.496957:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 40017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.496964:0:40017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 40017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.496985:0:40017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 40017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096588.497010:0:40017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887ad80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345532672:192.168.203.145@tcp:101:rm.0 00000100:00100000:2.0:1787096588.497096:0:40017:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c88b8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.499048:0:40017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887ad80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345532672:192.168.203.145@tcp:101:rm.0 00010000:00010000:2.0:1787096588.499062:0:40017:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.499073:0:40017:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.499079:0:40017:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.499087:0:40017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.499095:0:40017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.499110:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.499119:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.499132:0:40017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096588.499140:0:40017:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25c887ad80 x1873906345532672/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 576/584 e 0 to 0 dl 1787096604 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096588.499148:0:40017:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.499155:0:40017:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589935617/32 (0 0) 00000080:00200000:2.0:1787096588.499159:0:40017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787096588.499174:0:40017:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0x20:0x0], updating i_size 7680 00000080:00010000:2.0:1787096588.499178:0:40017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x20:0x0](ffff8d25c8d8aa08) for lock 0x93bbba3c5a0d874a 00000080:00010000:2.0:1787096588.499183:0:40017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x20:0x0](ffff8d25c8d8aa08) 00000080:00010000:2.0:1787096588.499186:0:40017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d874a from it ffffa5c141613cb8 00010000:00010000:2.0:1787096588.499189:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.499195:0:40017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096588.499244:0:40017:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096588.499254:0:40017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096588.499262:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00010000:00010000:2.0:1787096588.499271:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00000080:00200000:2.0:1787096588.499284:0:40017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096588.499289:0:40017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096588.499292:0:40017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8640 00000080:00010000:2.0:1787096588.499297:0:40017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8640 from it ffffa5c141613bf8 00010000:00010000:2.0:1787096588.499300:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 28 lru_type: 1 00010000:00010000:2.0:1787096588.499308:0:40017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00000080:00200000:2.0:1787096588.499316:0:40017:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096588.499321:0:40017:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d27a.sanity-ec, flags=266 00000080:00200000:2.0:1787096588.499326:0:40017:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08), inode mode 41ed mask 44 00000080:00200008:2.0:1787096588.499342:0:40017:0:(file.c:1058:ll_file_open()) START file d27a.sanity-ec:[0x200000401:0x20:0x0](ffff8d25c8d8aa08), flags 704400 00000080:00200008:2.0:1787096588.499366:0:40017:0:(file.c:6271:ll_getattr_dentry()) START file d27a.sanity-ec:[0x200000401:0x20:0x0](ffff8d25c8d8aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787096588.499371:0:40017:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08),name=d27a.sanity-ec 00000002:00010000:2.0:1787096588.499383:0:40017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x20:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096588.499391:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096588.499400:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096588.499407:0:40017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096588.499411:0:40017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x20:0x0](ffff8d25c8d8aa08) 00000080:00010000:2.0:1787096588.499414:0:40017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x20:0x0](ffff8d25c8d8aa08) for lock 0x93bbba3c5a0d874a 00000080:00010000:2.0:1787096588.499425:0:40017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d874a from it ffffa5c141613cd8 00010000:00010000:2.0:1787096588.499429:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096588.499437:0:40017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096588.499477:0:40017:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08) pos/size0/7680 32bit_api 0 00000002:00010000:2.0:1787096588.499488:0:40017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x20:0x0]) in obj [0x200000401:0x20:0x0], intent: readdir flags 0 00010000:00010000:2.0:1787096588.499495:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096588.499504:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1787096588.500152:0:40017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887ad80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345532800:192.168.203.145@tcp:37:rm.0 00000100:00100000:2.0:1787096588.500638:0:40017:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c88b8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.504748:0:40017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887ad80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345532800:192.168.203.145@tcp:37:rm.0 00010000:00010000:2.0:1787096588.505476:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096588.505492:0:40017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:2.0:1787096588.505580:0:40017:0:(file.c:448:ll_file_release()) START file d27a.sanity-ec:[0x200000401:0x20:0x0](ffff8d25c8d8aa08), flags 704000 00010000:00010000:2.0:1787096588.505604:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873800/0x93bbba3c5a0d8678 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634043 expref: -99 pid: 39563 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:2.0:1787096588.505656:0:40017:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096588.505671:0:40017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096588.505681:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00010000:00010000:2.0:1787096588.505690:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00000080:00200000:2.0:1787096588.505697:0:40017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096588.505703:0:40017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096588.505707:0:40017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8640 00000080:00010000:2.0:1787096588.505712:0:40017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8640 from it ffffa5c141613bf8 00010000:00010000:2.0:1787096588.505715:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 29 lru_type: 1 00010000:00010000:2.0:1787096588.505756:0:40017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00000080:00200000:2.0:1787096588.505769:0:40017:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096588.505776:0:40017:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d27a.sanity-ec, flags=266 00000080:00200000:2.0:1787096588.505783:0:40017:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08), inode mode 41ed mask 44 00000080:00200008:2.0:1787096588.505790:0:40017:0:(file.c:1058:ll_file_open()) START file d27a.sanity-ec:[0x200000401:0x20:0x0](ffff8d25c8d8aa08), flags 704400 00000080:00200008:2.0:1787096588.505809:0:40017:0:(file.c:6271:ll_getattr_dentry()) START file d27a.sanity-ec:[0x200000401:0x20:0x0](ffff8d25c8d8aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787096588.505814:0:40017:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08),name=d27a.sanity-ec 00000002:00010000:2.0:1787096588.505827:0:40017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x20:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096588.505835:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096588.505851:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787096588.505858:0:40017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096588.505864:0:40017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x20:0x0](ffff8d25c8d8aa08) 00000080:00010000:2.0:1787096588.505866:0:40017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x20:0x0](ffff8d25c8d8aa08) for lock 0x93bbba3c5a0d874a 00000080:00010000:2.0:1787096588.505872:0:40017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d874a from it ffffa5c141613cd8 00010000:00010000:2.0:1787096588.505875:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096588.505884:0:40017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787096588.505948:0:40017:0:(llite_lib.c:2759:ll_statfs()) VFS Op:sb=lustre (ffff8d25d82bf800) d27a.sanity-ec proj=0 00000080:00000004:2.0:1787096588.505954:0:40017:0:(obd_class.h:1091:obd_statfs()) lustre-clilmv-ffff8d25d82bf800: age 263, max_age 267 00800000:00000004:2.0:1787096588.505961:0:40017:0:(obd_class.h:1091:obd_statfs()) lustre-MDT0000-mdc-ffff8d25d82bf800: age 263, max_age 267 00000100:00100000:2.0:1787096588.505996:0:40017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887ad80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345532928:192.168.203.145@tcp:41:rm.0 00000100:00100000:2.0:1787096588.506073:0:40017:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c88b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.507802:0:40017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887ad80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345532928:192.168.203.145@tcp:41:rm.0 00800000:00000004:2.0:1787096588.507820:0:40017:0:(obd_class.h:1117:obd_statfs()) lustre-MDT0000-mdc-ffff8d25d82bf800: update ffff8d25c80137d0 cache blocks 1883136/1885696 objects 235584/235918 00000080:00000004:2.0:1787096588.507826:0:40017:0:(obd_class.h:1117:obd_statfs()) lustre-clilmv-ffff8d25d82bf800: update ffff8d25c8010450 cache blocks 1883136/1885696 objects 235584/235918 00000080:00000004:2.0:1787096588.507829:0:40017:0:(llite_lib.c:2622:ll_statfs_internal()) MDC blocks 1883136/1885696 objects 235584/235918 00000080:00200000:2.0:1787096588.507847:0:40017:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08) pos/size0/7680 32bit_api 0 00000080:00200000:2.0:1787096588.507870:0:40017:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08) pos/size18446744073709551614/7680 32bit_api 0 00000080:00200000:2.0:1787096588.507885:0:40017:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096588.507901:0:40017:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f27a.sanity-ec, dir=[0x200000401:0x20:0x0](ffff8d25c8d8aa08), flags=0 00000080:00200000:2.0:1787096588.507906:0:40017:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f27a.sanity-ec, dir=[0x200000401:0x20:0x0](ffff8d25c8d8aa08), intent=getattr 00000002:00010000:2.0:1787096588.507920:0:40017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f27a.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000401:0x20:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096588.507969:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 40017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.507978:0:40017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 40017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.507986:0:40017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 40017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096588.508001:0:40017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887ad80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345533056:192.168.203.145@tcp:101:rm.0 00000100:00100000:2.0:1787096588.508056:0:40017:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c88b8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.509688:0:40017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887ad80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345533056:192.168.203.145@tcp:101:rm.0 00010000:00010000:2.0:1787096588.509703:0:40017:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.509720:0:40017:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.509756:0:40017:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.509767:0:40017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.509777:0:40017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.509793:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.509800:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.509807:0:40017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096588.509818:0:40017:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25c887ad80 x1873906345533056/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 584/1264 e 0 to 0 dl 1787096604 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096588.509828:0:40017:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 680 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787096588.509854:0:40017:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.509863:0:40017:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589935617/33 (0 0) 00000080:00200000:2.0:1787096588.509868:0:40017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000401:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787096588.509939:0:40017:0:(namei.c:147:ll_iget()) got inode: [0x200000401:0x21:0x0](ffff8d25c8d8f448): rc = 0 00000080:00200000:2.0:1787096588.509957:0:40017:0:(file.c:6803:ll_layout_conf()) [0x200000401:0x21:0x0]: layout version change: 4294967294 -> 10 00000080:00010000:2.0:1787096588.509965:0:40017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x21:0x0](ffff8d25c8d8f448) for lock 0x93bbba3c5a0d8751 00000080:00010000:2.0:1787096588.509972:0:40017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x21:0x0](ffff8d25c8d8f448) 00000080:00010000:2.0:1787096588.509975:0:40017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8751 from it ffffa5c141613df8 00010000:00010000:2.0:1787096588.509978:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.509994:0:40017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096588.510016:0:40017:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08), inode mode 41ed mask 3 00000080:00200000:2.0:1787096588.510022:0:40017:0:(namei.c:2404:ll_unlink()) VFS Op:name=f27a.sanity-ec, dir=[0x200000401:0x20:0x0](ffff8d25c8d8aa08) 00010000:00010000:2.0:1787096588.510056:0:40017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787096588.510071:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872800/0x93bbba3c5a0d8647 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f9b expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096588.510116:0:40017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096588.510133:0:40017:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0x21:0x0]: losing layout lock 00010000:00010000:2.0:1787096588.510161:0:40017:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096588.510168:0:40017:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 1/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787096588.510173:0:40017:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1787096588.510176:0:40017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873a00/0x93bbba3c5a0d8751 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xdf123ee4d63437d expref: -99 pid: 40017 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096588.510189:0:40017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872000/0x93bbba3c5a0d874a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d634361 expref: -99 pid: 40017 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000020:00100000:2.0:1787096588.510211:0:40017:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787096588.510217:0:40017:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c887ad80 x1873906345533312/t0(0) o36->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 496/1176 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096588.510232:0:40017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887ad80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345533312:192.168.203.145@tcp:36:rm.0 00000100:00100000:2.0:1787096588.510284:0:40017:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c88b8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.515059:0:40017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887ad80 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345533312:192.168.203.145@tcp:36:rm.0 00000080:00200000:2.0:1787096588.515131:0:40017:0:(vvp_io.c:1944:vvp_io_init()) [0x200000401:0x21:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787096588.515142:0:40017:0:(lov_io.c:726:lov_io_mirror_init()) [0x200000401:0x21:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787096588.515145:0:40017:0:(lov_io.c:791:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787096588.515151:0:40017:0:(lov_io.c:1185:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787096588.515171:0:40017:0:(lov_io.c:1185:lov_io_iter_init()) component[1] flags 0x10 00020000:00200000:2.0:1787096588.515198:0:40017:0:(lov_io.c:1185:lov_io_iter_init()) component[2] flags 0x0 00000080:00200000:2.0:1787096588.515231:0:40017:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x21:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787096588.515239:0:40017:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000401:0x21:0x0](ffff8d25c8d8f448) 00000080:00200008:2.0:1787096588.515349:0:40017:0:(file.c:448:ll_file_release()) START file d27a.sanity-ec:[0x200000401:0x20:0x0](ffff8d25c8d8aa08), flags 704000 00010000:00010000:2.0:1787096588.515371:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873800/0x93bbba3c5a0d8678 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634043 expref: -99 pid: 39563 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000080:00200000:2.0:1787096588.515406:0:40017:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096588.515421:0:40017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096588.515430:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00010000:00010000:2.0:1787096588.515440:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00000080:00200000:2.0:1787096588.515471:0:40017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096588.515477:0:40017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096588.515480:0:40017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8640 00000080:00010000:2.0:1787096588.515487:0:40017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8640 from it ffffa5c141613c10 00010000:00010000:2.0:1787096588.515491:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 30 lru_type: 1 00010000:00010000:2.0:1787096588.515499:0:40017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:2.0:1787096588.515512:0:40017:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096588.515520:0:40017:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d27a.sanity-ec, flags=0 00000080:00200000:2.0:1787096588.515525:0:40017:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096588.515531:0:40017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096588.515537:0:40017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:2.0:1787096588.515545:0:40017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00000080:00200000:2.0:1787096588.515551:0:40017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096588.515555:0:40017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096588.515557:0:40017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8640 00000080:00010000:2.0:1787096588.515560:0:40017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8640 from it ffffa5c141613d88 00010000:00010000:2.0:1787096588.515563:0:40017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 31 lru_type: 1 00010000:00010000:2.0:1787096588.515580:0:40017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000080:00200000:2.0:1787096588.515588:0:40017:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 3 00000080:00200000:2.0:1787096588.515594:0:40017:0:(namei.c:2314:ll_rmdir()) VFS Op:name=d27a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00010000:00010000:2.0:1787096588.515610:0:40017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:2.0:1787096588.515630:0:40017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873800/0x93bbba3c5a0d8678 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d634043 expref: -99 pid: 39563 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000002:00100000:2.0:1787096588.515664:0:40017:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8d25c887a680 x1873906345519488/t4294967424(4294967424) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 648/608 e 0 to 0 dl 1787096602 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787096588.515675:0:40017:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787096588.515679:0:40017:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c887a300 x1873906345533568/t0(0) o35->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:23/10 lens 392/1176 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787096588.515698:0:40017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887a300 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345533568:192.168.203.145@tcp:35:rm.0 00000100:00100000:2.0:1787096588.515775:0:40017:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c88b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.517702:0:40017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887a300 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345533568:192.168.203.145@tcp:35:rm.0 00000002:00100000:2.0:1787096588.517753:0:40017:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8d25c887a680 x1873906345519488/t4294967424(4294967424) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 648/608 e 0 to 0 dl 1787096602 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787096588.517800:0:40017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872800/0x93bbba3c5a0d8647 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d633f9b expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096588.517843:0:40017:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873800/0x93bbba3c5a0d8678 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d634043 expref: -99 pid: 39563 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787096588.517850:0:40017:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872800/0x93bbba3c5a0d8647 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d633f9b expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096588.517856:0:40017:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00010000:00010000:2.0:1787096588.517861:0:40017:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1787096588.517864:0:40017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873800/0x93bbba3c5a0d8678 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d634043 expref: -99 pid: 39563 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787096588.517874:0:40017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872800/0x93bbba3c5a0d8647 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d633f9b expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096588.517889:0:40017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25ca309000/0x93bbba3c5a0d8640 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d633f7f expref: -99 pid: 39561 timeout: 0 lvb_type: 0 lru_score: 32 lru_type: 1 00000020:00100000:2.0:1787096588.517908:0:40017:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787096588.517914:0:40017:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c887a300 x1873906345533824/t0(0) o36->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 504/1176 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096588.517929:0:40017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887a300 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345533824:192.168.203.145@tcp:36:rm.0 00000100:00100000:2.0:1787096588.517974:0:40017:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25c88b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.521285:0:40017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887a300 pname:cluuid:pid:xid:nid:opc:job rm:7354022b-ee92-4e63-a611-5f745ec24594:40017:1873906345533824:192.168.203.145@tcp:36:rm.0 00000080:00200000:2.0:1787096588.521342:0:40017:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000401:0x20:0x0](ffff8d25c8d8aa08) 00010000:00010000:3.0F:1787096589.268835:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096589.460858:0:2357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6:2357:1873906345533952:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096589.460880:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345534080:192.168.203.145@tcp:400:kworker.0 00000100:00100000:3.0:1787096589.460934:0:2357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7354022b-ee92-4e63-a611-5f745ec24594:2357:1873906345534208:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096589.460938:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345534336:192.168.203.145@tcp:400:kworker.0 00000100:00100000:3.0:1787096589.462492:0:2357:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6:2357:1873906345533952:192.168.203.145@tcp:400:kworker.0 00000100:00100000:3.0:1787096589.462518:0:2357:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7354022b-ee92-4e63-a611-5f745ec24594:2357:1873906345534208:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096589.462561:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345534080:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096589.462575:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345534336:192.168.203.145@tcp:400:kworker.0 00010000:00010000:3.0:1787096590.292886:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0F:1787096591.315065:0:40290:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27b: test we can create -c n --ec 4+2 with n OSTs ========================================================== 19:43:10 (1787096590) 00010000:00010000:3.0:1787096591.321378:0:5561:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096591.848860:0:40430:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27b needs >= 8 OSTs 00000100:00100000:0.0:1787096592.289962:0:2348:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.145@tcp (source: 12345-192.168.203.145@tcp) 00000100:00100000:1.0:1787096592.289992:0:5552:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353907200 00000100:00100000:1.0:1787096592.290002:0:5552:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353907200 00000100:00100000:1.0:1787096592.290094:0:5552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.145@tcp, seq: 38 00000100:00100000:1.0:1787096592.290106:0:5552:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8d25d92eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:6538:x1873906353907200:12345-192.168.203.145@tcp:104: 00010000:00010000:1.0:1787096592.290122:0:5552:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8d25d82bf800 lock: 00000000149e4de4/0x93bbba3c5a0d8704 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0xdf123ee4d634281 expref: -99 pid: 39585 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096592.290200:0:5552:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787096592.290208:0:5552:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8d25d92eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:6538:x1873906353907200:12345-192.168.203.145@tcp:104: Request processed in 104us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096592.290215:0:5552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.145@tcp, seq: 38 00010000:00010000:2.0:1787096592.290234:0:39592:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096592.290248:0:39592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8d25d82bf800 lock: 00000000149e4de4/0x93bbba3c5a0d8704 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0xdf123ee4d634281 expref: -99 pid: 39585 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096592.290266:0:39592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d260217e200 already unused, calling callback (ffffffffc121a2a0) 00010000:00010000:2.0:1787096592.290275:0:39592:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8d25d82bf800 lock: 00000000149e4de4/0x93bbba3c5a0d8704 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0xdf123ee4d634281 expref: -99 pid: 39585 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096592.290406:0:39592:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8d25d82bf800 lock: 00000000149e4de4/0x93bbba3c5a0d8704 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0xdf123ee4d634281 expref: -99 pid: 39585 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096592.290415:0:39592:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096592.290452:0:39592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8d25d82bf800 lock: 00000000149e4de4/0x93bbba3c5a0d8704 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0xdf123ee4d634281 expref: -99 pid: 39585 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096592.290462:0:39592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8d25d82bf800 lock: 00000000149e4de4/0x93bbba3c5a0d8704 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0xdf123ee4d634281 expref: -99 pid: 39585 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787096592.290482:0:2357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7354022b-ee92-4e63-a611-5f745ec24594:2357:1873906345534464:192.168.203.145@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096592.290491:0:39592:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096592.290494:0:39592:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096592.290510:0:39592:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096592.292035:0:2357:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7354022b-ee92-4e63-a611-5f745ec24594:2357:1873906345534464:192.168.203.145@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096592.340834:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096592.423586:0:40583:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27c: test creating with n+2 OSTs ======= 19:43:11 (1787096591) 00000001:02000400:0.0:1787096592.997596:0:40723:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27c needs >= 8 OSTs 00010000:00010000:3.0:1787096593.364906:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096593.642686:0:40876:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27d: test raidset OSTs allocations are valid for -C 8 --ec 5+2 ========================================================== 19:43:13 (1787096593) 00000001:02000400:2.0:1787096594.190071:0:41016:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27d needs >= 8 OSTs 00010000:00010000:3.0:1787096594.389096:0:5561:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096594.581888:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6:2358:1873906345534592:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096594.581976:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345534848:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096594.582002:0:2358:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787096594.582005:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345534720:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096594.582020:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345534976:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096594.583173:0:2358:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8d25d82bf800: committing for last_committed 4294967447 gen 1 00000100:00100000:2.0:1787096594.583194:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345534720:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096594.583205:0:2358:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8d25d82bf800: committing for last_committed 4294967303 gen 2 00000100:00100000:2.0:1787096594.583646:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345534976:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096594.583660:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6:2358:1873906345534592:192.168.203.145@tcp:400:kworker.0 00000100:00100000:2.0:1787096594.583668:0:2358:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8d25d82bf800: committing for last_committed 4294967307 gen 3 00000100:00100000:2.0:1787096594.584432:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345534848:192.168.203.145@tcp:400:kworker.0 00000001:02000400:0.0:1787096594.811176:0:41169:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27e: test raidset OSTs allocations are valid for -C 13 --ec 5+2 ========================================================== 19:43:14 (1787096594) 00000001:02000400:1.0:1787096595.364862:0:41309:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27e needs >= 8 OSTs 00010000:00010000:3.0:1787096595.412874:0:39592:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096595.979056:0:41462:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27f: test raidset OSTs allocations are valid for -C 20 --ec 5+2 ========================================================== 19:43:15 (1787096595) 00010000:00010000:2.0:1787096596.436842:0:6019:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096596.513162:0:41603:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27f needs >= 8 OSTs 00000001:02000400:2.0:1787096597.085327:0:41756:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28a: EC parity correctly tracks writes through hardlinks ========================================================== 19:43:16 (1787096596) 00000080:00200000:3.0:1787096597.144199:0:41774:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:3.0:1787096597.144225:0:41774:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096597.144302:0:41774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 41774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096597.144312:0:41774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 41774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096597.144329:0:41774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 41774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096597.144354:0:41774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f6680 pname:cluuid:pid:xid:nid:opc:job mkdir:7354022b-ee92-4e63-a611-5f745ec24594:41774:1873906345535104:192.168.203.145@tcp:101:mkdir.0 00000100:00100000:3.0:1787096597.144453:0:41774:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25d0a399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096597.146046:0:41774:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f6680 pname:cluuid:pid:xid:nid:opc:job mkdir:7354022b-ee92-4e63-a611-5f745ec24594:41774:1873906345535104:192.168.203.145@tcp:101:mkdir.0 00010000:00010000:3.0:1787096597.146108:0:41774:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096597.146121:0:41774:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096597.146135:0:41774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096597.146152:0:41774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096597.146163:0:41774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096597.146173:0:41774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096597.146182:0:41774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787096597.146207:0:41774:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25c58f6680 x1873906345535104/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096613 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787096597.146223:0:41774:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096597.146236:0:41774:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1787096597.146242:0:41774:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787096597.146271:0:41774:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:3.0:1787096597.146290:0:41774:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8758 00000080:00010000:3.0:1787096597.146296:0:41774:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:3.0:1787096597.146300:0:41774:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8758 from it ffffa5c141c27be0 00010000:00010000:3.0:1787096597.146303:0:41774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096597.146313:0:41774:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096597.146338:0:41774:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:3.0:1787096597.146355:0:41774:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=d28a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), flags=1536 00000080:00200000:3.0:1787096597.146360:0:41774:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:3.0:1787096597.146368:0:41774:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096597.146375:0:41774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096597.146385:0:41774:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096597.146403:0:41774:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096597.146408:0:41774:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:3.0:1787096597.146412:0:41774:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8758 00000080:00010000:3.0:1787096597.146417:0:41774:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8758 from it ffffa5c141c27ce0 00010000:00010000:3.0:1787096597.146421:0:41774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096597.146430:0:41774:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096597.146443:0:41774:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 3 00000080:00200000:3.0:1787096597.146449:0:41774:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:3.0:1787096597.146454:0:41774:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096597.146460:0:41774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096597.146469:0:41774:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787096597.146476:0:41774:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787096597.146479:0:41774:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:3.0:1787096597.146482:0:41774:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d8758 00000080:00010000:3.0:1787096597.146484:0:41774:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8758 from it ffffa5c141c27dc8 00010000:00010000:3.0:1787096597.146487:0:41774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787096597.146506:0:41774:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787096597.146515:0:41774:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 3 00000080:00200000:3.0:1787096597.146521:0:41774:0:(namei.c:2225:do_mkdir()) VFS Op:name=d28a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00010000:00010000:3.0:1787096597.146555:0:41774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096597.146594:0:41774:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787096597.146601:0:41774:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096597.146604:0:41774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d260217fc00/0x93bbba3c5a0d8758 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xdf123ee4d6343d8 expref: -99 pid: 41774 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:3.0:1787096597.146628:0:41774:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787096597.146635:0:41774:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c58f6680 x1873906345535360/t0(0) o36->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 560/1128 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096597.146652:0:41774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f6680 pname:cluuid:pid:xid:nid:opc:job mkdir:7354022b-ee92-4e63-a611-5f745ec24594:41774:1873906345535360:192.168.203.145@tcp:36:mkdir.0 00000100:00100000:3.0:1787096597.146709:0:41774:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25d0a399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096597.149088:0:41774:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f6680 pname:cluuid:pid:xid:nid:opc:job mkdir:7354022b-ee92-4e63-a611-5f745ec24594:41774:1873906345535360:192.168.203.145@tcp:36:mkdir.0 00000080:00200000:3.0:1787096597.149134:0:41774:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000401:0x23:0x0](ffff8d25c8d19148) 00000080:00200000:3.0:1787096597.149141:0:41774:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0x23:0x0], updating i_size 512 00000080:00200000:2.0:1787096597.163702:0:41779:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096597.163746:0:41779:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096597.163801:0:41779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.163811:0:41779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.163827:0:41779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096597.163849:0:41779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345535488:192.168.203.145@tcp:101:lfs.0 00000100:00100000:2.0:1787096597.163932:0:41779:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25e03a49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096597.165244:0:41779:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345535488:192.168.203.145@tcp:101:lfs.0 00010000:00010000:2.0:1787096597.165257:0:41779:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.165264:0:41779:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.165273:0:41779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.165294:0:41779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.165302:0:41779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.165307:0:41779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.165312:0:41779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096597.165329:0:41779:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8d25c8879880 x1873906345535488/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096613 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096597.165338:0:41779:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.165345:0:41779:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1787096597.165349:0:41779:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787096597.165365:0:41779:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:2.0:1787096597.165369:0:41779:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d875f 00000080:00010000:2.0:1787096597.165372:0:41779:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096597.165374:0:41779:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d875f from it ffffa5c141c27b58 00010000:00010000:2.0:1787096597.165376:0:41779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.165381:0:41779:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096597.165396:0:41779:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096597.165407:0:41779:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=d28a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), flags=24 00000080:00200000:2.0:1787096597.165409:0:41779:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d28a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), intent=0 00000002:00010000:2.0:1787096597.165419:0:41779:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d28a.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1787096597.165433:0:41779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.165438:0:41779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.165449:0:41779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096597.165458:0:41779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345535616:192.168.203.145@tcp:101:lfs.0 00000100:00100000:2.0:1787096597.165497:0:41779:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25e03a49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096597.167253:0:41779:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345535616:192.168.203.145@tcp:101:lfs.0 00010000:00010000:2.0:1787096597.167262:0:41779:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167272:0:41779:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167286:0:41779:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167291:0:41779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167296:0:41779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167302:0:41779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167306:0:41779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167317:0:41779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096597.167323:0:41779:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8d25c8879880 x1873906345535616/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096613 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096597.167329:0:41779:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167333:0:41779:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589935617/35 (0 0) 00000080:00200000:2.0:1787096597.167337:0:41779:0:(namei.c:952:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787096597.167345:0:41779:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0x23:0x0], updating i_size 512 00000080:00200000:2.0:1787096597.167347:0:41779:0:(namei.c:147:ll_iget()) got inode: [0x200000401:0x23:0x0](ffff8d25c8d19148): rc = 0 00000080:00010000:2.0:1787096597.167350:0:41779:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x23:0x0](ffff8d25c8d19148) for lock 0x93bbba3c5a0d8766 00000080:00010000:2.0:1787096597.167356:0:41779:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x23:0x0](ffff8d25c8d19148) 00000080:00010000:2.0:1787096597.167358:0:41779:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8766 from it ffffa5c141c27a28 00010000:00010000:2.0:1787096597.167359:0:41779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167364:0:41779:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873600/0x93bbba3c5a0d8766 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634410 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096597.167375:0:41779:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x23:0x0](ffff8d25c8d19148), inode mode 41ed mask 1 00000080:00200000:2.0:1787096597.167382:0:41779:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f28a.sanity-ec, dir=[0x200000401:0x23:0x0](ffff8d25c8d19148), flags=8 00000080:00200000:2.0:1787096597.167384:0:41779:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f28a.sanity-ec, dir=[0x200000401:0x23:0x0](ffff8d25c8d19148), intent=getattr 00000002:00010000:2.0:1787096597.167389:0:41779:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f28a.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000401:0x23:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096597.167401:0:41779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167409:0:41779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.167414:0:41779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096597.167423:0:41779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345535744:192.168.203.145@tcp:101:lfs.0 00000100:00100000:2.0:1787096597.167457:0:41779:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25e03a49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096597.168398:0:41779:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345535744:192.168.203.145@tcp:101:lfs.0 00010000:00010000:2.0:1787096597.168405:0:41779:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.168410:0:41779:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.168414:0:41779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 4/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.168417:0:41779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.168421:0:41779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.168425:0:41779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d25c8873200 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:2.0:1787096597.168427:0:41779:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.168431:0:41779:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.168440:0:41779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 5/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.168444:0:41779:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787096597.168446:0:41779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.168450:0:41779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873200/0x93bbba3c5a0d876d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096597.168457:0:41779:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8d25c8879880 x1873906345535744/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096613 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787096597.168464:0:41779:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000401:0x23:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787096597.168471:0:41779:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 30 res 8589935617/35 (0 0) 00000080:00200000:2.0:1787096597.168504:0:41779:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08),name=/ 00000002:00010000:2.0:1787096597.168510:0:41779:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096597.168520:0:41779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096597.168529:0:41779:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096597.168533:0:41779:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096597.168535:0:41779:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) 00000080:00010000:2.0:1787096597.168537:0:41779:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8d25c8d1aa08) for lock 0x93bbba3c5a0d875f 00000080:00010000:2.0:1787096597.168539:0:41779:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d875f from it ffffa5c141c27bf8 00010000:00010000:2.0:1787096597.168541:0:41779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096597.168552:0:41779:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872a00/0x93bbba3c5a0d875f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d6343f4 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096597.168558:0:41779:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8d25c8d1aa08), inode mode 41ed mask 1 00000080:00200000:2.0:1787096597.168562:0:41779:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d28a.sanity-ec, flags=25 00000080:00200000:2.0:1787096597.168564:0:41779:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x23:0x0](ffff8d25c8d19148), inode mode 41ed mask 1 00000080:00200000:2.0:1787096597.168570:0:41779:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x23:0x0](ffff8d25c8d19148), inode mode 41ed mask 3 00000080:00200000:2.0:1787096597.168573:0:41779:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f28a.sanity-ec, dir=[0x200000401:0x23:0x0](ffff8d25c8d19148), file ffff8d25d82ef080, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787096597.168577:0:41779:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f28a.sanity-ec, dir=[0x200000401:0x23:0x0](ffff8d25c8d19148), intent=open|creat 00000002:00010000:2.0:1787096597.168586:0:41779:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f28a.sanity-ec,[0x200000401:0x24:0x0]) in obj [0x200000401:0x23:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787096597.168605:0:41779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.168609:0:41779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787096597.168614:0:41779:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787096597.168618:0:41779:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c8879880 x1873906345536000/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/66872 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787096597.168623:0:41779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096597.168631:0:41779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345536000:192.168.203.145@tcp:101:lfs.0 00000100:00100000:2.0:1787096597.168701:0:41779:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25e03a49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096597.170258:0:41779:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c8879880 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345536000:192.168.203.145@tcp:101:lfs.0 00010000:00010000:2.0:1787096597.170273:0:41779:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.170304:0:41779:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 4/0,1 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.170311:0:41779:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 4/0,1 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.170318:0:41779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.170325:0:41779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.170334:0:41779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.170340:0:41779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.170346:0:41779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096597.170354:0:41779:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8d25c8879880 x1873906345536000/t4294967449(4294967449) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096613 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787096597.170364:0:41779:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8d25c8879880 x1873906345536000/t4294967449(4294967449) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096613 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096597.170372:0:41779:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.170384:0:41779:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8d25c80f1400 type 13 mode 4 res 8589935617/36 (0 0) 00000080:00200000:2.0:1787096597.170388:0:41779:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000401:0x23:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787096597.170395:0:41779:0:(namei.c:1619:ll_create_it()) VFS Op:name=f28a.sanity-ec, dir=[0x200000401:0x23:0x0](ffff8d25c8d19148), intent=open|creat 00000080:00200000:2.0:1787096597.170412:0:41779:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000401:0x24:0x0](ffff8d25c8d8aa08) 00000080:00200000:2.0:1787096597.170416:0:41779:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0x24:0x0], updating i_size 0 00000080:00200000:2.0:1787096597.170479:0:41779:0:(file.c:6803:ll_layout_conf()) [0x200000401:0x24:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787096597.170487:0:41779:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000401:0x24:0x0](ffff8d25c8d8aa08) 00000080:00010000:2.0:1787096597.170490:0:41779:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x24:0x0](ffff8d25c8d8aa08) for lock 0x93bbba3c5a0d8774 00000080:00010000:2.0:1787096597.170496:0:41779:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x24:0x0](ffff8d25c8d8aa08) 00000080:00200008:2.0:1787096597.170504:0:41779:0:(file.c:1058:ll_file_open()) START file f28a.sanity-ec:[0x200000401:0x24:0x0](ffff8d25c8d8aa08), flags 120501 00000002:00100000:2.0:1787096597.170518:0:41779:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8d25c8879880 x1873906345536000/t4294967449(4294967449) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096613 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787096597.170543:0:41779:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x93bbba3c5a0d8774 from it ffff8d25d9334540 00010000:00010000:2.0:1787096597.170547:0:41779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.170554:0:41779:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096597.170566:0:41779:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x24:0x0](ffff8d25c8d8aa08), inode mode 81a4 mask 40 00000080:00200000:2.0:1787096597.170597:0:41779:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000401:0x24:0x0](ffff8d25c8d8aa08), inode mode 81a4 mask 2 00000080:00200000:2.0:1787096597.170605:0:41779:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000401:0x24:0x0](ffff8d25c8d8aa08), xattr lov 00000002:00010000:2.0:1787096597.170616:0:41779:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x24:0x0]) in obj [0x200000401:0x23:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787096597.170638:0:41779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.170653:0:41779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787096597.170662:0:41779:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787096597.170666:0:41779:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c887b100 x1873906345536256/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 1200/132408 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787096597.170673:0:41779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096597.170686:0:41779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887b100 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345536256:192.168.203.145@tcp:101:lfs.0 00000100:00100000:2.0:1787096597.170858:0:41779:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25e03a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787096597.171697:0:2347:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.145@tcp (source: 12345-192.168.203.145@tcp) 00000100:00100000:1.0:1787096597.171757:0:35957:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353908352 00000100:00100000:1.0:1787096597.171764:0:35957:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353908352 00000100:00100000:1.0:1787096597.171808:0:35957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.145@tcp, seq: 39 00000100:00100000:1.0:1787096597.171816:0:35957:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8d25d92edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7354022b-ee92-4e63-a611-5f745ec24594+5:5764:x1873906353908352:12345-192.168.203.145@tcp:104: 00010000:00010000:1.0:1787096597.171825:0:35957:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096597.171861:0:35957:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787096597.171865:0:35957:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8d25d92edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7354022b-ee92-4e63-a611-5f745ec24594+5:5764:x1873906353908352:12345-192.168.203.145@tcp:104: Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096597.171870:0:35957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.145@tcp, seq: 39 00010000:00010000:3.0:1787096597.171891:0:5562:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096597.171899:0:5562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096597.171920:0:5562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d25c8873000 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:3.0:1787096597.171923:0:5562:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096597.171929:0:5562:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096597.171935:0:5562:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787096597.171958:0:5562:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0x24:0x0]: losing layout lock 00010000:00010000:3.0:1787096597.171992:0:5562:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096597.171996:0:5562:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096597.172014:0:5562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096597.172018:0:5562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8873000/0x93bbba3c5a0d8774 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xdf123ee4d634441 expref: -99 pid: 41779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787096597.172030:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096597.172032:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096597.172034:0:2358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c58f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345536384:192.168.203.145@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096597.172035:0:5562:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096597.172800:0:2358:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c58f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7354022b-ee92-4e63-a611-5f745ec24594:2358:1873906345536384:192.168.203.145@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787096597.173117:0:41779:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887b100 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345536256:192.168.203.145@tcp:101:lfs.0 00010000:00010000:2.0:1787096597.173125:0:41779:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 4/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.173131:0:41779:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 4/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.173135:0:41779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 4/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.173139:0:41779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.173143:0:41779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.173153:0:41779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d25c8872200 already unused, calling callback (ffffffffc1b9cb70) 00010000:00010000:2.0:1787096597.173155:0:41779:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.173158:0:41779:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.173162:0:41779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 5/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.173165:0:41779:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787096597.173167:0:41779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.173170:0:41779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8d25d82bf800 lock: ffff8d25c8872200/0x93bbba3c5a0d877b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 41779 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096597.173178:0:41779:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8d25c887b100 x1873906345536256/t0(0) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 1200/608 e 0 to 0 dl 1787096613 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787096597.173186:0:41779:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000401:0x23:0x0] suppgids 0 0: rc -28 00000080:00200000:2.0:1787096597.173189:0:41779:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:2.0:1787096597.173336:0:41779:0:(file.c:448:ll_file_release()) START file f28a.sanity-ec:[0x200000401:0x24:0x0](ffff8d25c8d8aa08), flags 100001 00000002:00100000:2.0:1787096597.173359:0:41779:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8d25c8879880 x1873906345536000/t4294967449(4294967449) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096613 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787096597.173366:0:41779:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8d25d82bf800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787096597.173369:0:41779:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d25c887b100 x1873906345536640/t0(0) o35->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:23/10 lens 392/1176 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787096597.173378:0:41779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d25c887b100 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345536640:192.168.203.145@tcp:35:lfs.0 00000100:00100000:2.0:1787096597.173409:0:41779:0:(client.c:2692:ptlrpc_set_wait()) set ffff8d25e03a49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096597.174093:0:41779:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8d25c887b100 pname:cluuid:pid:xid:nid:opc:job lfs:7354022b-ee92-4e63-a611-5f745ec24594:41779:1873906345536640:192.168.203.145@tcp:35:lfs.0 00000002:00100000:2.0:1787096597.174102:0:41779:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8d25c8879880 x1873906345536000/t4294967449(4294967449) o101->lustre-MDT0000-mdc-ffff8d25d82bf800@192.168.203.145@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096613 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787096597.460889:0:5561:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096597.624983:0:41904:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_28a: @@@@@@ FAIL: setstripe failed Debug log: 529 lines, 529 kept, 0 dropped, 0 bad.