00010000:00010000:2.0F:1786119016.822581:0:27761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786119017.630240:0:30176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-lfsck test 7a: non-stopped LFSCK should auto restarts after MDS remount (1) ========================================================== 12:10:17 (1786119017) 00000080:00200000:3.0F:1786119017.719769:0:30044:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08),name=/ 00000002:00010000:3.0:1786119017.719800:0:30044:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1786119017.719878:0:30044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 30044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786119017.719888:0:30044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786119017.719898:0:30044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 30044 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786119017.719923:0:30044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e6728c6a00 pname:cluuid:pid:xid:nid:opc:job bash:75c9383d-90c0-437a-a973-62621ebb56ee:30044:1872881164069376:192.168.202.143@tcp:101:bash.0 00000100:00100000:3.0:1786119017.719996:0:30044:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e65877e900 going to sleep for 11 seconds 00000100:00100000:3.0:1786119017.722178:0:30044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e6728c6a00 pname:cluuid:pid:xid:nid:opc:job bash:75c9383d-90c0-437a-a973-62621ebb56ee:30044:1872881164069376:192.168.202.143@tcp:101:bash.0 00010000:00010000:3.0:1786119017.722195:0:30044:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786119017.722205:0:30044:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786119017.722216:0:30044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786119017.722226:0:30044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786119017.722237:0:30044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786119017.722245:0:30044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786119017.722258:0:30044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1786119017.722295:0:30044:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff91e6728c6a00 x1872881164069376/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 576/688 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1786119017.722320:0:30044:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786119017.722331:0:30044:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff91e647873c00 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1786119017.722336:0:30044:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1786119017.722369:0:30044:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1786119017.722376:0:30044:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) for lock 0x54eb093fd0672da 00000080:00010000:3.0:1786119017.722381:0:30044:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) 00000080:00010000:3.0:1786119017.722384:0:30044:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672da from it ffffa9b207f37bb0 00010000:00010000:3.0:1786119017.722387:0:30044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786119017.722395:0:30044:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1786119017.722416:0:30044:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08), inode mode 41ed mask 44 00000080:00200008:3.0:1786119017.722424:0:30044:0:(file.c:1090:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff91e65969cb08), flags 304000 00000080:00200008:3.0:1786119017.722439:0:30044:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff91e65969cb08), request_mask 2047, flags 0, foreign 0 00000002:00010000:3.0:1786119017.722453:0:30044:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: readdir flags 0 00010000:00010000:3.0:1786119017.722460:0:30044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1786119017.722479:0:30044:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1786119017.723002:0:30044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e6728c6a00 pname:cluuid:pid:xid:nid:opc:job bash:75c9383d-90c0-437a-a973-62621ebb56ee:30044:1872881164069504:192.168.202.143@tcp:37:bash.0 00000100:00100000:3.0:1786119017.723060:0:30044:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e65877e900 going to sleep for 11 seconds 00000100:00100000:3.0:1786119017.727362:0:30044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e6728c6a00 pname:cluuid:pid:xid:nid:opc:job bash:75c9383d-90c0-437a-a973-62621ebb56ee:30044:1872881164069504:192.168.202.143@tcp:37:bash.0 00010000:00010000:3.0:1786119017.727994:0:30044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1786119017.728012:0:30044:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1786119017.728036:0:30044:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08),name=/ 00000002:00010000:3.0:1786119017.728054:0:30044:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1786119017.728068:0:30044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1786119017.728078:0:30044:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1786119017.728085:0:30044:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1786119017.728090:0:30044:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) 00000080:00010000:3.0:1786119017.728093:0:30044:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) for lock 0x54eb093fd0672da 00000080:00010000:3.0:1786119017.728097:0:30044:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672da from it ffffa9b207f37cd8 00010000:00010000:3.0:1786119017.728100:0:30044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1786119017.728117:0:30044:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1786119017.728228:0:30044:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08) pos/size0/4096 32bit_api 0 00000080:00200000:3.0:1786119017.728295:0:30044:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:3.0:1786119017.728341:0:30044:0:(file.c:479:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff91e65969cb08), flags 304000 00000080:00200000:1.0F:1786119017.731182:0:30192:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08),name=/ 00000002:00010000:1.0:1786119017.731204:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1786119017.731219:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1786119017.731233:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1786119017.731241:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1786119017.731246:0:30192:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) 00000080:00010000:1.0:1786119017.731249:0:30192:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) for lock 0x54eb093fd0672da 00000080:00010000:1.0:1786119017.731255:0:30192:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672da from it ffffa9b207defb58 00010000:00010000:1.0:1786119017.731258:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1786119017.731281:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1786119017.731294:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08), inode mode 41ed mask 1 00000080:00200000:1.0:1786119017.731304:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d5.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff91e65969cb08), flags=8 00000080:00200000:1.0:1786119017.731309:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d5.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff91e65969cb08), intent=getattr 00000002:00010000:1.0:1786119017.731320:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d5.sanity-lfsck,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 01 00010000:00010000:1.0:1786119017.731357:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.731364:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.731374:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786119017.731409:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e64437ad80 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164069632:192.168.202.143@tcp:101:rm.0 00000100:00100000:1.0:1786119017.731480:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e65813d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786119017.735277:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e64437ad80 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164069632:192.168.202.143@tcp:101:rm.0 00010000:00010000:1.0:1786119017.735297:0:30192:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.735316:0:30192:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 4/1,0 mode: --/PR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.735325:0:30192:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 4/1,0 mode: --/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.735336:0:30192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 4/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.735347:0:30192:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 4/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.735368:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 5/2,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.735376:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 5/2,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.735383:0:30192:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 4/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1786119017.735409:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff91e64437ad80 x1872881164069632/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/688 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1786119017.735422:0:30192:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 3/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.735432:0:30192:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff91e647873c00 type 13 mode 4 res 8589955617/1 (0 0) 00000080:00200000:1.0:1786119017.735438:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1786119017.735460:0:30192:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200005221:0x1:0x0], updating i_size 4096 00000080:00200000:1.0:1786119017.735463:0:30192:0:(namei.c:147:ll_iget()) got inode: [0x200005221:0x1:0x0](ffff91e6597a9148): rc = 0 00000080:00010000:1.0:1786119017.735468:0:30192:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200005221:0x1:0x0](ffff91e6597a9148) for lock 0x54eb093fd0672e1 00000080:00010000:1.0:1786119017.735478:0:30192:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200005221:0x1:0x0](ffff91e6597a9148) 00000080:00010000:1.0:1786119017.735482:0:30192:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672e1 from it ffffa9b207defb20 00010000:00010000:1.0:1786119017.735485:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 3/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.735493:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/0,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1786119017.735522:0:30192:0:(file.c:6283:ll_getattr_dentry()) START file d5.sanity-lfsck:[0x200005221:0x1:0x0](ffff91e6597a9148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1786119017.735528:0:30192:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148),name=d5.sanity-lfsck 00000002:00010000:1.0:1786119017.735544:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200005221:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1786119017.735551:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1786119017.735561:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1786119017.735577:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1786119017.735581:0:30192:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200005221:0x1:0x0](ffff91e6597a9148) 00000080:00010000:1.0:1786119017.735585:0:30192:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200005221:0x1:0x0](ffff91e6597a9148) for lock 0x54eb093fd0672e1 00000080:00010000:1.0:1786119017.735589:0:30192:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672e1 from it ffffa9b207defcb8 00010000:00010000:1.0:1786119017.735592:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 3/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1786119017.735600:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/0,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1786119017.735647:0:30192:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08),name=/ 00000002:00010000:1.0:1786119017.735653:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1786119017.735660:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1786119017.735668:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1786119017.735675:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1786119017.735678:0:30192:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) 00000080:00010000:1.0:1786119017.735681:0:30192:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) for lock 0x54eb093fd0672da 00000080:00010000:1.0:1786119017.735684:0:30192:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672da from it ffffa9b207defbf8 00010000:00010000:1.0:1786119017.735687:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1786119017.735695:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1786119017.735708:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08), inode mode 41ed mask 1 00000080:00200000:1.0:1786119017.735714:0:30192:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d5.sanity-lfsck, flags=266 00000080:00200000:1.0:1786119017.735719:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 44 00000080:00200008:1.0:1786119017.735725:0:30192:0:(file.c:1090:ll_file_open()) START file d5.sanity-lfsck:[0x200005221:0x1:0x0](ffff91e6597a9148), flags 704400 00000002:00010000:1.0:1786119017.735736:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200005221:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:1.0:1786119017.735769:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.735776:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1786119017.735786:0:30192:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff91e6599c0800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1786119017.735792:0:30192:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff91e64437ad80 x1872881164069888/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1786119017.735801:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786119017.735982:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e64437ad80 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164069888:192.168.202.143@tcp:101:rm.0 00000100:00100000:1.0:1786119017.736118:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e65813d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786119017.737258:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e64437ad80 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164069888:192.168.202.143@tcp:101:rm.0 00010000:00010000:1.0:1786119017.737293:0:30192:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.737303:0:30192:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.737324:0:30192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 4/1,0 mode: CR/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.737332:0:30192:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 4/1,0 mode: CR/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1786119017.737344:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff91e64437ad80 x1872881164069888/t47244640548(47244640548) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1786119033 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1786119017.737356:0:30192:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff91e64437ad80 x1872881164069888/t47244640548(47244640548) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 648/664 e 0 to 0 dl 1786119033 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1786119017.737369:0:30192:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 3/1,0 mode: CR/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.737378:0:30192:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff91e647873c00 type 13 mode 16 res 8589955617/1 (0 0) 00000080:00200000:1.0:1786119017.737383:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1786119017.737396:0:30192:0:(llite_lib.c:3127:ll_update_inode()) inode=[0x200005221:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1786119017.737400:0:30192:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200005221:0x1:0x0](ffff91e6597a9148) for lock 0x54eb093fd0672e8 00000080:00010000:1.0:1786119017.737405:0:30192:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672e8 from it ffffa9b207defbd0 00010000:00010000:1.0:1786119017.737409:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 3/1,0 mode: CR/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.737417:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 2/0,0 mode: CR/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1786119017.737435:0:30192:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff91e64437ad80 x1872881164069888/t47244640548(47244640548) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 520/664 e 0 to 0 dl 1786119033 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1786119017.737512:0:30192:0:(file.c:6283:ll_getattr_dentry()) START file d5.sanity-lfsck:[0x200005221:0x1:0x0](ffff91e6597a9148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1786119017.737518:0:30192:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148),name=d5.sanity-lfsck 00000002:00010000:1.0:1786119017.737529:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200005221:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1786119017.737536:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1786119017.737546:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1786119017.737552:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1786119017.737556:0:30192:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200005221:0x1:0x0](ffff91e6597a9148) 00000080:00010000:1.0:1786119017.737559:0:30192:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200005221:0x1:0x0](ffff91e6597a9148) for lock 0x54eb093fd0672e1 00000080:00010000:1.0:1786119017.737563:0:30192:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672e1 from it ffffa9b207defcd8 00010000:00010000:1.0:1786119017.737566:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 3/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1786119017.737573:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/0,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1786119017.737630:0:30192:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1786119017.737644:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200005221:0x1:0x0]) in obj [0x200005221:0x1:0x0], intent: readdir flags 0 00010000:00010000:1.0:1786119017.737651:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1786119017.737660:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1786119017.738238:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e644378380 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070016:192.168.202.143@tcp:37:rm.0 00000100:00100000:1.0:1786119017.738297:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e65813d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786119017.744142:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e644378380 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070016:192.168.202.143@tcp:37:rm.0 00010000:00010000:1.0:1786119017.744939:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 3/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1786119017.744954:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/0,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:1.0:1786119017.745072:0:30192:0:(file.c:479:ll_file_release()) START file d5.sanity-lfsck:[0x200005221:0x1:0x0](ffff91e6597a9148), flags 704000 00010000:00010000:1.0:1786119017.745097:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 2/0,0 mode: CR/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1786119017.745142:0:30192:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08),name=/ 00000002:00010000:1.0:1786119017.745156:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1786119017.745166:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1786119017.745173:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1786119017.745180:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1786119017.745185:0:30192:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) 00000080:00010000:1.0:1786119017.745189:0:30192:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) for lock 0x54eb093fd0672da 00000080:00010000:1.0:1786119017.745194:0:30192:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672da from it ffffa9b207defbf8 00010000:00010000:1.0:1786119017.745198:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1786119017.745217:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000080:00200000:1.0:1786119017.745226:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08), inode mode 41ed mask 1 00000080:00200000:1.0:1786119017.745233:0:30192:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d5.sanity-lfsck, flags=266 00000080:00200000:1.0:1786119017.745239:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 44 00000080:00200008:1.0:1786119017.745245:0:30192:0:(file.c:1090:ll_file_open()) START file d5.sanity-lfsck:[0x200005221:0x1:0x0](ffff91e6597a9148), flags 704400 00000080:00200008:1.0:1786119017.745263:0:30192:0:(file.c:6283:ll_getattr_dentry()) START file d5.sanity-lfsck:[0x200005221:0x1:0x0](ffff91e6597a9148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1786119017.745280:0:30192:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148),name=d5.sanity-lfsck 00000002:00010000:1.0:1786119017.745292:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200005221:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1786119017.745300:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1786119017.745308:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1786119017.745315:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1786119017.745318:0:30192:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200005221:0x1:0x0](ffff91e6597a9148) 00000080:00010000:1.0:1786119017.745321:0:30192:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200005221:0x1:0x0](ffff91e6597a9148) for lock 0x54eb093fd0672e1 00000080:00010000:1.0:1786119017.745325:0:30192:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672e1 from it ffffa9b207defcd8 00010000:00010000:1.0:1786119017.745328:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 3/1,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1786119017.745335:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/0,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1786119017.745400:0:30192:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148) pos/size0/4096 32bit_api 0 00000080:00200000:1.0:1786119017.745493:0:30192:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1786119017.745507:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:1.0:1786119017.745517:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-scrub.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:1.0:1786119017.745520:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-scrub.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:1.0:1786119017.745530:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-scrub.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:1.0:1786119017.745570:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.745578:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.745587:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786119017.745606:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e644378380 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070144:192.168.202.143@tcp:101:rm.0 00000100:00100000:1.0:1786119017.745666:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e65813d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786119017.747619:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e644378380 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070144:192.168.202.143@tcp:101:rm.0 00010000:00010000:1.0:1786119017.747633:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.747644:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.747650:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.747656:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.747672:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.747678:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e672835800 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:1.0:1786119017.747682:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.747689:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.747697:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.747713:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1786119017.747719:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.747726:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835800/0x54eb093fd0672ef lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1786119017.747743:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e644378380 x1872881164070144/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1786119017.747755:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:1.0:1786119017.747802:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:1.0:1786119017.747974:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-nfsv4.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:1.0:1786119017.747979:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfsv4.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:1.0:1786119017.747996:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfsv4.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:1.0:1786119017.748041:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.748052:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.748061:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786119017.748077:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e644378380 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070272:192.168.202.143@tcp:101:rm.0 00000100:00100000:1.0:1786119017.748127:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e65813d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786119017.753339:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e644378380 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070272:192.168.202.143@tcp:101:rm.0 00010000:00010000:1.0:1786119017.753357:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753368:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753376:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753383:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753391:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753397:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e672835e00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:1.0:1786119017.753402:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753408:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753427:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753433:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1786119017.753439:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753446:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835e00/0x54eb093fd0672f6 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1786119017.753465:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e644378380 x1872881164070272/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1786119017.753479:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:1.0:1786119017.753529:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:1.0:1786119017.753544:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-hsm.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:1.0:1786119017.753548:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-hsm.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:1.0:1786119017.753567:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-hsm.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:1.0:1786119017.753606:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753614:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.753622:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786119017.753640:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e644378380 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070400:192.168.202.143@tcp:101:rm.0 00000100:00100000:1.0:1786119017.753700:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e65813d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786119017.764587:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e644378380 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070400:192.168.202.143@tcp:101:rm.0 00010000:00010000:1.0:1786119017.764617:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.764631:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.764638:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.764644:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.764652:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.764657:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e672835c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:1.0:1786119017.764662:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.764669:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.764675:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.764682:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1786119017.764687:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786119017.764693:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835c00/0x54eb093fd0672fd lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1786119017.764719:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e644378380 x1872881164070400/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1786119017.764734:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:1.0:1786119017.764783:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:1.0:1786119017.764799:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_iozone.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:1.0:1786119017.764803:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_iozone.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:1.0:1786119017.764866:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_iozone.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0F:1786119017.764975:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.764991:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.765001:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.765095:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e644378380 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070528:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.765161:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.769413:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e644378380 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070528:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.769428:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769437:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769441:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769446:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769453:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769460:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1e00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.769463:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769470:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769488:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769494:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.769499:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769503:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067304 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.769515:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e644378380 x1872881164070528/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.769526:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.769572:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.769584:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-oss-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.769587:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-oss-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.769604:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-oss-scale.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.769633:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769646:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.769654:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.769674:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070656:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.769743:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.771065:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070656:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.771077:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771085:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771091:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771097:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771103:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771108:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.771111:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771116:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771122:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771128:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.771132:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771138:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06730b lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.771162:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164070656/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.771173:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.771198:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.771209:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup-cifs.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.771212:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup-cifs.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.771224:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup-cifs.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.771244:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771250:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.771255:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.771265:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070784:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.771323:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.772438:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070784:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.772448:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772456:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772462:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772478:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772485:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772490:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.772494:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772500:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772506:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772512:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.772516:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772521:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067312 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.772534:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164070784/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.772543:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.772565:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.772574:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-sec.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.772578:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-sec.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.772587:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-sec.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.772613:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772621:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.772627:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.772639:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070912:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.773145:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.776384:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164070912:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.776397:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776407:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776414:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776421:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776428:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776434:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.776438:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776470:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776477:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776484:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.776489:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776505:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067319 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.776520:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164070912/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.776538:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.776570:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.776581:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lnet.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.776585:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lnet.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.776598:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lnet.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.776624:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776632:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.776640:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.776655:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071040:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.776707:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.778093:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071040:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.778103:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778111:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778179:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778186:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778193:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778199:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1e00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.778202:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778207:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778213:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778219:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.778223:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778240:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067320 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.778254:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164071040/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.778265:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.778322:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.778332:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=scrub-performance.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.778336:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=scrub-performance.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.778359:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: scrub-performance.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.778379:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778386:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.778393:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.778405:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071168:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.778457:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.779527:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071168:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.779537:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779547:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779563:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779570:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779576:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779581:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.779584:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779590:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779597:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779603:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.779606:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779612:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067327 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.779623:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164071168/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.779633:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.779653:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.779665:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=yaml.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.779668:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=yaml.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.779677:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: yaml.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.779696:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779703:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.779710:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.779721:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071296:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.779795:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.780800:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071296:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.780823:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780832:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780838:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780844:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780851:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780856:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.780865:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780871:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780877:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780882:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.780887:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780893:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06732e lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.780905:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164071296/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.780915:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.780933:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.780941:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-benchmark.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.780944:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-benchmark.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.780953:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-benchmark.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.780970:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780977:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.780984:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.781004:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071424:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.781069:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.782209:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071424:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.782219:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782228:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782235:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782241:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782247:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782252:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.782255:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782261:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782282:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782289:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.782298:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782305:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067335 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.782316:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164071424/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.782326:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.782344:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.782353:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f0, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.782356:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f0, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.782364:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f0,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.782381:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782388:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.782395:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.782405:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071552:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.782439:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.783452:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071552:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.783461:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.783469:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.783485:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.783491:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.783498:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.783503:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.783506:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.783512:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.783518:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.783524:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.783527:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.783533:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06733c lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.783615:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164071552/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.783939:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.783980:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.783994:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-ost-single.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.783997:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-ost-single.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.784029:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-ost-single.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.784064:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.784090:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.784117:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.784144:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071680:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.784258:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.785405:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071680:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.785414:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785423:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785429:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785436:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785442:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785457:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.785461:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785467:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785490:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785497:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.785501:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785507:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd067343 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.785519:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164071680/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.785529:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.785547:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.785556:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.785559:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.785568:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.785585:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785592:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.785611:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.785623:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071808:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.786069:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.788470:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071808:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.788478:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788492:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788497:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788502:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788506:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788510:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.788512:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788517:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788527:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788537:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.788541:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788545:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd06734a lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.788555:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164071808/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.788562:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.788581:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.788588:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanityn.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.788591:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanityn.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.788600:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanityn.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.788619:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788624:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.788628:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.788637:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071936:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.788667:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.790542:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164071936:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.790552:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790567:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790573:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790579:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790585:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790606:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.790610:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790616:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790623:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790628:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.790632:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790647:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067351 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.790660:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164071936/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.790681:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.790717:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.790726:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lfsck.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.790730:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lfsck.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.790739:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lfsck.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.790763:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790770:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.790778:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.790790:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072064:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.790847:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.791998:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072064:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.792073:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792084:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792090:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792096:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792113:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792119:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1e00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.792122:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792129:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792135:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792141:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.792145:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792152:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067358 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.792165:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164072064/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.792174:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.792195:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.792204:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=acceptance-small.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.792207:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=acceptance-small.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.792216:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: acceptance-small.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.792237:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792255:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.792263:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.792295:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072192:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.792335:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.796440:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072192:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.796451:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796460:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796466:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796471:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796478:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796484:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.796487:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796491:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796502:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796506:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.796509:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796513:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06735f lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.796620:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164072192/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.796632:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.796655:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.796662:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-nfs.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.796665:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfs.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.796678:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfs.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.796700:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796714:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.796721:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.796731:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072320:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.796773:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.797922:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072320:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.797932:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.797941:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.797948:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.797955:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.797961:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.797967:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.797970:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.797976:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.797982:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.797988:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.797991:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.797997:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067366 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.798019:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164072320/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.798029:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.798047:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.798055:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-scale-lib.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.798059:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-scale-lib.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.798068:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-scale-lib.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.798086:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.798093:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.798100:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.798111:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072448:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.798148:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.800264:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072448:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.800285:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800294:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800300:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800315:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800321:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800326:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.800329:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800335:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800341:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800346:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.800350:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800354:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06736d lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.800367:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164072448/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.800376:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.800397:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.800406:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=racer.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.800409:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=racer.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.800418:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: racer.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.800445:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800452:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.800459:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.800471:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072576:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.800500:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.801498:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072576:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.801505:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801511:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801515:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801519:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801523:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801526:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.801528:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801539:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801543:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801546:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.801548:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801551:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067374 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.801559:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164072576/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.801566:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.801581:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.801586:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-selinux.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.801588:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-selinux.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.801595:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-selinux.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.801608:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801613:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.801617:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.801624:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072704:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.801659:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.802544:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072704:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.802550:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802555:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802559:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802562:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802566:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802569:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.802571:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802574:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802578:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802581:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.802584:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802594:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd06737b lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.802602:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164072704/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.802608:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.802622:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.802628:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=obdfilter-survey.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.802631:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=obdfilter-survey.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.802637:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: obdfilter-survey.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.802649:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802654:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.802658:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.802665:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072832:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.802688:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.803552:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072832:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.803558:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803562:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803573:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803577:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803580:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803583:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.803585:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803588:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803592:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803595:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.803598:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803601:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067382 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.803608:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164072832/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.803614:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.803628:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.803638:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lcov-merge.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.803640:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lcov-merge.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.803646:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lcov-merge.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.803660:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803665:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.803669:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.803676:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072960:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.803698:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.804682:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164072960:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.804688:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804693:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804696:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804700:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804703:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804713:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414000 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.804716:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804720:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804723:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804726:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.804729:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804732:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067389 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.804739:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164072960/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.804745:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.804759:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.804768:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_dd.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.804770:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_dd.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.804776:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_dd.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.804789:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804793:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.804821:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.804830:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073088:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.804853:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.805796:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073088:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.805802:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805820:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805824:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805827:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805831:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805834:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415800 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.805835:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805839:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805842:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805850:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.805853:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805856:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067390 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.805863:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164073088/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.805869:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.805883:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.805889:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_tar.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.805892:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_tar.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.805898:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_tar.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.805910:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805914:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.805919:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.805925:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073216:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.805948:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.806933:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073216:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.806939:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.806949:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.806952:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.806956:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.806959:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.806962:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.806964:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.806967:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.806973:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.806978:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.806981:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.806987:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067397 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.806998:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164073216/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.807028:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.807043:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.807048:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.807050:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-lsnapshot.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.807057:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-lsnapshot.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.807069:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.807073:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.807078:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.807085:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073344:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.807107:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.808138:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073344:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.808148:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808156:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808163:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808169:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808186:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808190:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.808192:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808195:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808199:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808202:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.808204:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808208:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06739e lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.808216:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164073344/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.808223:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.808239:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.808245:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_dbench.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.808247:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_dbench.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.808254:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_dbench.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.808280:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808296:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.808304:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.808326:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073472:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.808354:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.809179:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073472:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.809185:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809190:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809194:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809197:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809201:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809204:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414200 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.809205:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809209:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809217:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809220:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.809223:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809226:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0673a5 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.809233:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164073472/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.809239:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.809254:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.809259:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lnet-selftest.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.809261:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lnet-selftest.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.809279:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lnet-selftest.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.809293:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809297:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.809301:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.809312:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073600:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.809346:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.810146:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073600:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.810158:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810163:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810166:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810170:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810173:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810176:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.810178:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810181:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810184:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810187:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.810189:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810193:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0673ac lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.810205:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164073600/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.810211:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.810226:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.810231:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run_IOR.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.810233:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run_IOR.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.810239:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run_IOR.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.810251:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810256:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.810260:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.810277:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073728:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.810300:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.811247:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073728:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.811254:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811258:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811262:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811288:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811293:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811296:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.811298:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811301:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811307:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811313:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.811317:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811323:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0673b3 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.811334:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164073728/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.811343:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.811360:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.811368:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-cifs.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.811371:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-cifs.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.811385:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-cifs.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.811402:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811408:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.811415:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.811426:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073856:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.811453:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.812366:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073856:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.812376:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812383:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812388:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812393:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812399:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812403:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1e00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.812406:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812417:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812422:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812427:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.812430:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812441:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0673ba lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.812458:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164073856/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.812467:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.812487:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.812493:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lockorder.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.812495:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lockorder.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.812502:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lockorder.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.812516:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812520:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.812527:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.812538:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073984:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.812574:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.813467:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164073984:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.813473:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813478:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813482:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813486:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813489:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813492:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.813494:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813497:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813500:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813503:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.813506:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813516:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0673c1 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.813523:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164073984/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.813529:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.813544:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.813550:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-random-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.813552:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-random-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.813558:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-random-scale.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.813571:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813575:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.813580:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.813586:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074112:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.813610:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.814674:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074112:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.814686:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814696:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814726:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814733:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814740:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814745:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.814749:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814755:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814767:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814773:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.814777:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814783:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0673c8 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.814796:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164074112/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 600/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.814822:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.814844:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.814857:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=maloo_upload.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.814860:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=maloo_upload.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.814871:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: maloo_upload.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.814892:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814899:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.814905:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.814918:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074240:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.814954:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.815959:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074240:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.815976:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.815984:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.815989:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.815994:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.816000:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.816014:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fda00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.816017:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.816022:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.816028:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.816033:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.816037:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.816042:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd0673cf lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.816053:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164074240/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.816062:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.816082:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.816091:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-small.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.816094:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-small.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.816102:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-small.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.816121:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.816127:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.816143:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.816153:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074368:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.816225:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.817217:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074368:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.817225:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817232:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817238:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817243:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817249:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817254:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fde00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.817257:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817262:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817284:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817295:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.817299:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817304:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd0673d6 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.817315:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164074368/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.817323:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.817342:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.817350:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup-nfs.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.817353:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup-nfs.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.817361:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup-nfs.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.817379:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817386:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.817392:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.817402:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074496:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.817433:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.818328:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074496:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.818337:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818350:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818357:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818363:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818368:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818374:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fd600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.818377:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818383:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818389:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818394:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.818398:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818404:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd600/0x54eb093fd0673dd lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.818415:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164074496/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.818434:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.818453:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.818460:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=ost-pools.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.818464:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ost-pools.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.818472:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ost-pools.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.818491:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818497:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.818505:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.818515:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074624:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.818546:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.819570:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074624:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.819579:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819587:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819593:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819599:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819616:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819622:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fd400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.819625:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819631:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819637:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819643:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.819646:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819652:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd400/0x54eb093fd0673e4 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.819664:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164074624/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.819672:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.819690:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.819698:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=setup_kerberos.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.819701:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=setup_kerberos.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.819709:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: setup_kerberos.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.819736:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819751:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.819758:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.819769:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074752:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.819799:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.820880:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074752:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.820888:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.820896:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.820902:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.820907:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.820912:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.820918:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fdc00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.820920:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.820926:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.820938:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.820944:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.820947:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.820953:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fdc00/0x54eb093fd0673eb lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.820964:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164074752/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.820973:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.820990:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.820997:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=conf-sanity.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.821001:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=conf-sanity.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.821009:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: conf-sanity.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.821034:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.821040:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.821047:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.821058:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074880:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.821086:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.821995:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164074880:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.822010:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822017:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822022:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822028:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822034:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822039:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fd800 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.822042:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822047:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822052:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822057:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.822061:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822066:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd800/0x54eb093fd0673f2 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.822084:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164074880/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.822093:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.822118:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.822126:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-dual.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.822129:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-dual.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.822137:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-dual.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.822155:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822161:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.822168:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.822178:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075008:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.822208:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.823032:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075008:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.823041:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823048:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823055:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823070:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823077:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823083:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fc400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.823085:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823091:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823097:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823102:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.823105:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823111:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc400/0x54eb093fd0673f9 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.823123:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164075008/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.823140:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.823158:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.823165:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=functions.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.823168:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=functions.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.823177:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: functions.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.823199:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823205:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.823212:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.823223:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075136:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.823252:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.824334:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075136:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.824343:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824350:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824356:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824362:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824369:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824374:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fc000 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.824377:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824393:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824399:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824404:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.824408:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824414:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fc000/0x54eb093fd067400 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.824424:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164075136/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.824433:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.824451:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.824459:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=mmp.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.824462:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=mmp.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.824470:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: mmp.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.824487:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824494:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.824501:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.824511:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075264:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.824545:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.825456:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075264:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.825465:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825472:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825478:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825484:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825490:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825495:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fd200 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.825499:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825504:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825509:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825514:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.825518:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825533:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd200/0x54eb093fd067407 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.825544:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164075264/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.825553:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.825570:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.825580:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale-nfsv3.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.825583:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale-nfsv3.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.825591:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale-nfsv3.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.825608:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825614:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.825621:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.825631:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075392:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.825659:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.826482:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075392:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.826491:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826499:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826514:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826520:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826526:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826532:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fd000 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.826535:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826541:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826547:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826553:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.826557:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826563:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fd000/0x54eb093fd06740e lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.826574:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164075392/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.826583:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.826604:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.826616:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=pjdfstest.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.826619:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=pjdfstest.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.826628:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: pjdfstest.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.826648:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826655:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.826662:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.826673:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075520:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.826707:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.827581:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075520:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.827587:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827592:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827596:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827600:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827612:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827622:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.827625:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827628:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827632:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827635:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.827638:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827641:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067415 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.827649:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164075520/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.827656:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.827671:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.827677:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=performance-sanity.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.827679:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=performance-sanity.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.827685:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: performance-sanity.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.827698:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827703:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.827715:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.827722:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075648:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.827747:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.828527:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075648:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.828533:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828538:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828542:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828546:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828549:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828552:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.828554:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828564:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828567:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828577:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.828579:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828583:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd06741c lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.828590:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164075648/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.828597:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.828611:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.828616:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-ec.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.828618:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-ec.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.828625:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-ec.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.828643:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828648:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.828652:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.828659:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075776:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.828683:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.829584:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075776:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.829591:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829606:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829610:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829615:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829618:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829621:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414200 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.829623:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829626:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829630:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829633:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.829635:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829639:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd067423 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.829646:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164075776/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.829659:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.829674:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.829680:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-mds-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.829683:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-mds-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.829689:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-mds-scale.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.829703:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829709:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.829716:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.829727:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075904:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.829758:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.830794:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164075904:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.830801:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830820:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830827:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830834:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830850:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830856:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.830859:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830865:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830872:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830877:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.830881:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830887:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd06742a lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.830898:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164075904/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.830904:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.830919:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.830925:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=dne_sanity.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.830927:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=dne_sanity.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.830934:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: dne_sanity.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.830946:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830957:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.830962:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.830969:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076032:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.830992:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.832020:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076032:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.832026:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832031:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832035:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832038:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832042:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832045:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.832046:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832050:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832058:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832061:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.832064:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832067:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd067431 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.832075:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164076032/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.832080:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.832094:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.832100:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=dom-performance.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.832102:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=dom-performance.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.832108:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: dom-performance.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.832120:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832124:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.832128:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.832135:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076160:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.832160:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.833165:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076160:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.833174:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833181:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833187:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833193:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833199:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833204:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415800 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.833207:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833213:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833219:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833224:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.833228:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833234:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067438 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.833257:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164076160/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.833277:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.833296:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.833312:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-pfl.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.833318:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pfl.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.833327:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pfl.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.833344:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833350:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.833356:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.833371:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076288:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.833399:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.834306:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076288:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.834315:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834323:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834329:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834345:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834351:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834356:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414000 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.834359:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834365:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834371:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834376:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.834380:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834386:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd06743f lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.834397:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164076288/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.834406:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.834426:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.834435:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lustre-rsync-test.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.834439:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lustre-rsync-test.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.834455:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lustre-rsync-test.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.834481:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834487:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.834495:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.834507:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076416:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.834538:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.835372:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076416:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.835378:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835382:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835386:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835390:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835393:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835396:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fde00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.835398:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835406:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835409:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835412:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.835415:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835418:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fde00/0x54eb093fd067446 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.835425:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164076416/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.835431:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.835445:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.835455:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=oos2.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.835457:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=oos2.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.835464:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: oos2.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.835476:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835481:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.835485:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.835491:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076544:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.835518:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.836421:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076544:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.836431:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836438:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836445:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836451:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836458:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836463:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6821fda00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.836466:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836472:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836477:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836482:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.836486:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836501:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6821fda00/0x54eb093fd06744d lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.836513:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164076544/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.836522:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.836541:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.836548:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=conf-sanity-framework.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.836552:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=conf-sanity-framework.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.836560:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: conf-sanity-framework.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.836578:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836585:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.836591:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.836601:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076672:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.836630:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.837393:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076672:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.837403:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837410:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837425:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837431:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837438:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837443:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.837446:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837452:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837465:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837471:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.837475:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837481:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd067454 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.837493:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164076672/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 600/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.837502:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.837522:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.837536:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-single-lmv.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.837540:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-single-lmv.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.837548:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-single-lmv.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.837566:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837573:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.837580:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.837592:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076800:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.837624:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.838610:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076800:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.838619:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838627:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838633:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838639:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838645:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838659:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.838662:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838668:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838674:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838679:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.838683:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838689:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd06745b lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.838700:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164076800/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.838708:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.838727:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.838734:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=test-framework.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.838738:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=test-framework.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.838746:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: test-framework.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.838763:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838769:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.838785:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.838796:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076928:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.838841:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.839830:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164076928:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.839840:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839848:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839855:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839862:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839869:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839875:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1e00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.839878:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839883:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839890:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839900:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.839904:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839911:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd067462 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.839922:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164076928/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.839931:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.839948:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.839955:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=llmountcleanup.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.839958:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=llmountcleanup.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.839966:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: llmountcleanup.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.839984:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839991:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.839999:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.840009:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077056:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.840038:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.840900:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077056:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.840908:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.840921:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.840926:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.840931:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.840938:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.840943:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.840946:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.840951:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.840958:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.840964:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.840967:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.840974:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd067469 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.840984:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164077056/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.841003:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.841020:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.841027:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=llmount.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.841030:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=llmount.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.841047:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: llmount.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.841065:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.841072:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.841078:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.841089:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077184:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.841116:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.842050:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077184:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.842060:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842069:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842075:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842081:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842096:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842102:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.842105:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842111:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842117:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842122:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.842125:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842131:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd067470 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.842142:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164077184/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.842151:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.842170:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.842178:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sgpdd-survey.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.842181:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sgpdd-survey.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.842189:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sgpdd-survey.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.842206:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842221:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.842228:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.842239:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077312:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.842279:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.843189:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077312:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.843195:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843200:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843204:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843207:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843211:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843214:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.843216:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843219:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843227:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843230:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.843233:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843236:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd067477 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.843244:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164077312/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.843250:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.843263:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.843282:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=large-lun.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.843286:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=large-lun.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.843292:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: large-lun.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.843306:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843310:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.843315:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.843321:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077440:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.843349:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.844224:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077440:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.844238:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844246:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844252:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844258:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844263:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844281:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.844285:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844291:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844297:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844307:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.844311:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844320:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd06747e lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.844341:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164077440/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.844350:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.844368:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.844375:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=insanity.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.844379:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=insanity.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.844387:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: insanity.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.844403:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844411:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.844418:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.844428:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077568:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.844457:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.845405:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077568:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.845413:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845421:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845428:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845444:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845450:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845456:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.845460:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845464:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845471:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845476:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.845479:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845486:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd067485 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.845497:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164077568/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.845506:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.845523:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.845530:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-flr.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.845533:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-flr.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.845542:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-flr.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.845564:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845571:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.845577:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.845588:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077696:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.845616:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00010000:00010000:1.0:1786119017.845898:0:27760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786119017.846469:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077696:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.846477:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846484:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846491:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846497:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846503:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846508:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.846511:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846526:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846533:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846538:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.846542:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846548:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd06748c lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.846559:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164077696/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.846568:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.846584:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.846595:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=rpc.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.846598:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=rpc.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.846606:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: rpc.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.846622:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846629:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.846635:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.846645:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077824:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.846686:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.847743:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077824:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.847751:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847759:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847765:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847770:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847776:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847781:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414000 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.847784:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847789:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847795:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847800:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.847804:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847834:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414000/0x54eb093fd067493 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.847847:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164077824/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.847857:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.847884:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.847892:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=recovery-double-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.847895:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=recovery-double-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.847903:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: recovery-double-scale.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.847920:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847927:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.847933:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.847944:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077952:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.847972:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.848937:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164077952:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.848945:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.848953:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.848968:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.848974:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.848980:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.848986:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415800 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.848989:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.848995:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.849001:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.849007:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.849010:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.849016:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd06749a lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.849027:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164077952/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 600/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.849035:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.849052:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.849064:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-vbr.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.849067:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-vbr.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.849075:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-vbr.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.849092:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.849099:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.849105:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.849116:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078080:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.849144:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.850011:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078080:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.850019:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850026:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850033:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850039:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850044:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850059:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.850062:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850068:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850074:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850079:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.850083:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850089:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd0674a1 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.850100:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164078080/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.850108:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.850125:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.850133:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-pcc.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.850135:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-pcc.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.850143:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-pcc.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.850160:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850166:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.850182:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.850193:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078208:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.850221:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.851099:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078208:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.851107:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851113:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851117:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851121:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851124:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851127:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.851129:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851133:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851136:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851144:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.851147:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851150:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd0674a8 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.851158:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164078208/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.851164:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.851181:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.851188:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d0, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.851190:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d0, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.851197:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.851211:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851215:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.851219:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.851227:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078336:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.851252:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.852412:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078336:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.852422:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852441:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852447:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852452:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852458:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852463:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414200 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.852466:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852471:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852476:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852481:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.852485:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852490:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674af lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.852501:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164078336/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.852518:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.852538:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.852551:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d0, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.852555:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d0, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.852563:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d0,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.852582:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852588:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.852595:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.852605:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078464:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.852637:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.853731:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078464:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.853740:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853748:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853753:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853766:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853782:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853787:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.853790:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853796:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853801:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853824:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.853827:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853833:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415600/0x54eb093fd0674b6 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.853844:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164078464/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.853853:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.853872:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.853880:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-krb5.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.853883:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-krb5.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.853891:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-krb5.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.853909:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853923:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.853930:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.853941:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078592:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.853970:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.854845:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078592:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.854853:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.854860:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.854866:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.854871:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.854877:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.854882:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.854885:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.854890:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.854901:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.854906:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.854909:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.854915:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd0674bd lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.854925:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164078592/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.854933:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.854957:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.854964:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-quota.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.854967:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-quota.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.854975:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-quota.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.854994:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855000:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855006:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.855022:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078720:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.855052:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.855896:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078720:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.855910:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855917:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855922:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855927:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855933:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855938:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.855941:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855946:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855951:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855956:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.855960:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.855965:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1600/0x54eb093fd0674c4 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.855983:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164078720/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.855991:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.856010:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.856017:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=ha.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.856020:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ha.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.856028:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ha.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.856045:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.856051:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.856057:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.856067:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078848:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.856098:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.856949:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078848:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.856957:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.856964:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.856969:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.856985:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.856991:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.856996:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0600 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.856998:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.857004:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.857010:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.857014:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.857018:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.857023:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0600/0x54eb093fd0674cb lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.857033:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164078848/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.857041:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.857060:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.857067:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-compr.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.857070:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-compr.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.857078:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-compr.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.857101:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.857108:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.857114:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.857129:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078976:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.857159:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.857999:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164078976:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.858007:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858014:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858019:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858025:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858031:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858035:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.858038:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858052:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858057:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858062:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.858065:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858071:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0a00/0x54eb093fd0674d2 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.858081:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164078976/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.858089:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.858107:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.858114:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=oos.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.858117:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=oos.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.858124:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: oos.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.858141:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858147:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.858153:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.858163:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079104:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.858197:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.859144:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079104:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.859152:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859159:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859164:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859169:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859176:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859181:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.859184:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859189:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859194:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859199:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.859202:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859216:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1a00/0x54eb093fd0674d9 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.859226:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164079104/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 576/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.859234:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.859252:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.859259:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=sanity-dom.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.859262:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=sanity-dom.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.859283:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: sanity-dom.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.859313:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859319:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.859326:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.859336:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079232:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.859369:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.861043:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079232:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.861051:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861058:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861073:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861078:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861084:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861089:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.861092:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861097:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861103:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861108:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.861111:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861116:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1400/0x54eb093fd0674e0 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.861127:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164079232/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.861135:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.861153:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.861163:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=large-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.861166:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=large-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.861175:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: large-scale.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.861192:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861199:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.861205:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.861215:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079360:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.861245:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.862217:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079360:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.862225:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862232:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862237:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862243:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862248:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862264:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0400 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.862282:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862288:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862294:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862304:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.862308:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862314:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0400/0x54eb093fd0674e7 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.862325:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164079360/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.862333:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.862351:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.862359:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=parallel-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.862362:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=parallel-scale.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.862369:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: parallel-scale.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.862386:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862392:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.862408:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.862418:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079488:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.862446:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.863448:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079488:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.863456:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863464:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863469:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863474:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863480:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863485:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f1e00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.863488:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863493:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863498:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863509:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.863513:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863518:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f1e00/0x54eb093fd0674ee lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.863529:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164079488/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.863537:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.863556:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.863564:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=ost_oos.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.863567:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=ost_oos.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.863574:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ost_oos.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.863592:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863598:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.863604:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.863614:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079616:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.863645:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.864742:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079616:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.864751:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864763:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864768:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864773:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864779:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864783:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e6476f0c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.864786:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864791:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864796:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864801:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.864805:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864846:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e6476f0c00/0x54eb093fd0674f5 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.864856:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164079616/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.864875:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.864892:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.864900:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=mds-survey.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.864903:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=mds-survey.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.864910:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: mds-survey.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.864928:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864935:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.864942:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.864953:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079744:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.864987:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.866013:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079744:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.866025:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866034:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866051:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866061:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866078:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866084:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414200 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.866087:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866093:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866099:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866104:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.866106:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866110:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414200/0x54eb093fd0674fc lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.866119:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164079744/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.866126:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.866141:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.866147:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=lfsck-performance.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.866149:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=lfsck-performance.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.866156:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lfsck-performance.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.866169:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866181:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.866185:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.866193:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079872:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.866218:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.867229:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164079872:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.867236:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867241:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867245:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867248:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867252:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867255:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415a00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.867257:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867260:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867285:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867288:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.867291:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867295:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415a00/0x54eb093fd067503 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.867304:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164079872/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.867313:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.867334:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.867343:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=replay-single.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.867347:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=replay-single.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.867355:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: replay-single.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.867374:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867381:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.867388:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.867400:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164080000:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.867426:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.868440:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164080000:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.868456:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868464:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868471:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868477:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868483:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868490:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.868493:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868497:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868501:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868505:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.868507:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868511:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415c00/0x54eb093fd06750a lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.868528:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164080000/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 592/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.868538:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.868560:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.868572:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=krb5_login.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.868575:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=krb5_login.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.868584:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: krb5_login.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.868602:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868609:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.868616:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.868628:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164080128:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.868665:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.870299:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164080128:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.870322:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870331:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870336:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870353:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870360:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870363:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647415800 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.870366:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870369:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870373:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870377:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.870379:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870383:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647415800/0x54eb093fd067511 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.870393:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164080128/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.870408:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200000:0.0:1786119017.870439:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200005221:0x1:0x0](ffff91e6597a9148), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.870451:0:30192:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=run-llog.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), flags=0 00000080:00200000:0.0:1786119017.870454:0:30192:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=run-llog.sh, dir=[0x200005221:0x1:0x0](ffff91e6597a9148), intent=getattr 00000002:00010000:0.0:1786119017.870467:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: run-llog.sh,[0x0:0x0:0x0]) in obj [0x200005221:0x1:0x0], intent: getattr flags 01 00010000:00010000:0.0:1786119017.870492:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870496:0:30192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.870501:0:30192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 3/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786119017.870510:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164080256:192.168.202.143@tcp:101:rm.0 00000100:00100000:0.0:1786119017.870541:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.871647:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164080256:192.168.202.143@tcp:101:rm.0 00010000:00010000:0.0:1786119017.871653:0:30192:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.871659:0:30192:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.871662:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 4/1,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.871666:0:30192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.871669:0:30192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.871672:0:30192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91e647414c00 already unused, calling callback (ffffffffc1a012a0) 00010000:00010000:0.0:1786119017.871674:0:30192:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.871684:0:30192:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 4/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x206400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.871688:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 5/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x20e400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.871691:0:30192:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1786119017.871693:0:30192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 3/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786119017.871696:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e647414c00/0x54eb093fd067518 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x2/0x2 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 30192 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1786119017.871705:0:30192:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=-2 req@ffff91e643e76a00 x1872881164080256/t0(0) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1786119017.871712:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200005221:0x1:0x0] suppgids 0 -1: rc -2 00000080:00200008:0.0:1786119017.871742:0:30192:0:(file.c:479:ll_file_release()) START file d5.sanity-lfsck:[0x200005221:0x1:0x0](ffff91e6597a9148), flags 704000 00010000:00010000:0.0:1786119017.871759:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 2/0,0 mode: CR/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1786119017.871794:0:30192:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08),name=/ 00000002:00010000:0.0:1786119017.871803:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1786119017.871826:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1786119017.871832:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000080:00200000:0.0:1786119017.871837:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1786119017.871845:0:30192:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) 00000080:00010000:0.0:1786119017.871848:0:30192:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) for lock 0x54eb093fd0672da 00000080:00010000:0.0:1786119017.871852:0:30192:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672da from it ffffa9b207defc10 00010000:00010000:0.0:1786119017.871855:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1786119017.871868:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00000080:00200000:0.0:1786119017.871884:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08), inode mode 41ed mask 1 00000080:00200000:0.0:1786119017.871891:0:30192:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d5.sanity-lfsck, flags=0 00000080:00200000:0.0:1786119017.871896:0:30192:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08),name=/ 00000002:00010000:0.0:1786119017.871903:0:30192:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1786119017.871910:0:30192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00010000:00010000:0.0:1786119017.871915:0:30192:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00000080:00200000:0.0:1786119017.871919:0:30192:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1786119017.871922:0:30192:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) 00000080:00010000:0.0:1786119017.871923:0:30192:0:(llite_internal.h:1988:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff91e65969cb08) for lock 0x54eb093fd0672da 00000080:00010000:0.0:1786119017.871926:0:30192:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x54eb093fd0672da from it ffffa9b207defd88 00010000:00010000:0.0:1786119017.871928:0:30192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 1 00010000:00010000:0.0:1786119017.871932:0:30192:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00000080:00200000:0.0:1786119017.871946:0:30192:0:(file.c:6659:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff91e65969cb08), inode mode 41ed mask 3 00000080:00200000:0.0:1786119017.871950:0:30192:0:(namei.c:2328:ll_rmdir()) VFS Op:name=d5.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff91e65969cb08) 00010000:00010000:0.0:1786119017.871962:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1786119017.872006:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 2/0,0 mode: CR/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00100000:0.0:1786119017.872027:0:30192:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff91e64437ad80 x1872881164069888/t47244640548(47244640548) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 520/664 e 0 to 0 dl 1786119033 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1786119017.872034:0:30192:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff91e6599c0800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1786119017.872037:0:30192:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff91e643e76a00 x1872881164080512/t0(0) o35->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1786119017.872047:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164080512:192.168.202.143@tcp:35:rm.0 00000100:00100000:0.0:1786119017.872070:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.872847:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164080512:192.168.202.143@tcp:35:rm.0 00000002:00100000:0.0:1786119017.872860:0:30192:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff91e64437ad80 x1872881164069888/t47244640548(47244640548) o101->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 520/664 e 0 to 0 dl 1786119033 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1786119017.872884:0:30192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 2/0,0 mode: PR/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1786119017.872949:0:30192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 1/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1786119017.872957:0:30192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 1/0,0 mode: --/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1786119017.872969:0:30192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1786119017.872975:0:30192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1786119017.872977:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835000/0x54eb093fd0672e8 lrc: 0/0,0 mode: --/CR res: [0x200005221:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3e96fdb3ddc63336 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1786119017.872982:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e672835a00/0x54eb093fd0672e1 lrc: 0/0,0 mode: --/PR res: [0x200005221:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3e96fdb3ddc63328 expref: -99 pid: 30192 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1786119017.872991:0:30192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff91e6599c0800 lock: ffff91e67286fc00/0x54eb093fd0672da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x3e96fdb3ddc6330c expref: -99 pid: 30044 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00000020:00100000:0.0:1786119017.873001:0:30192:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff91e6599c0800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1786119017.873004:0:30192:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff91e643e76a00 x1872881164080768/t0(0) o36->lustre-MDT0000-mdc-ffff91e6599c0800@192.168.202.143@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786119017.873013:0:30192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164080768:192.168.202.143@tcp:36:rm.0 00000100:00100000:0.0:1786119017.873037:0:30192:0:(client.c:2702:ptlrpc_set_wait()) set ffff91e644c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1786119017.874144:0:30192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91e643e76a00 pname:cluuid:pid:xid:nid:opc:job rm:75c9383d-90c0-437a-a973-62621ebb56ee:30192:1872881164080768:192.168.202.143@tcp:36:rm.0 00000001:02000400:1.0:1786119018.420698:0:30319:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-lfsck test_7a: @@@@@@ FAIL: Fail to cleanup the env! 00010000:00010000:2.0:1786119018.869976:0:28409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 2159 lines, 2159 kept, 0 dropped, 0 bad.