00010000:00010000:2.0F:1782107380.151277:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1782107381.174327:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0F:1782107381.616825:0:27799:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:1.0:1782107381.616855:0:27799:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1782107381.616915:0:27799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107381.616926:0:27799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107381.616936:0:27799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107381.616961:0:27799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98181880 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:27799:1868674447235840:192.168.202.126@tcp:101:rm.0 00000100:00100000:1.0:1782107381.617200:0:27799:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc987d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1782107381.621175:0:27799:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc98181880 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:27799:1868674447235840:192.168.202.126@tcp:101:rm.0 00010000:00010000:2.0:1782107381.621199:0:27799:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107381.621212:0:27799:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107381.621225:0:27799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107381.621236:0:27799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107381.621248:0:27799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107381.621257:0:27799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107381.621264:0:27799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107381.621276:0:27799:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff98dc98181880 x1868674447235840/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1782107397 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1782107381.621288:0:27799:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107381.621299:0:27799:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff98dc88401000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1782107381.621313:0:27799:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1782107381.621339:0:27799:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:2.0:1782107381.621345:0:27799:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec6088b5 00000080:00010000:2.0:1782107381.621350:0:27799:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:2.0:1782107381.621353:0:27799:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec6088b5 from it ffffb7270163fb58 00010000:00010000:2.0:1782107381.621356:0:27799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107381.621365:0:27799:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1782107381.621390:0:27799:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 1 00000080:00200000:2.0:1782107381.621410:0:27799:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), flags=8 00000080:00200000:2.0:1782107381.621415:0:27799:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), intent=getattr 00000002:00010000:2.0:1782107381.621432:0:27799:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6e.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107381.621467:0:27799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 27799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107381.621474:0:27799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107381.621481:0:27799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107381.621501:0:27799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dca04ec380 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:27799:1868674447235968:192.168.202.126@tcp:101:rm.0 00000100:00100000:2.0:1782107381.621590:0:27799:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc8501bc00 going to sleep for 11 seconds 00000100:00100000:3.0F:1782107381.633723:0:27799:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dca04ec380 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:27799:1868674447235968:192.168.202.126@tcp:101:rm.0 00010000:00010000:3.0:1782107381.633966:0:27799:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107381.633988:0:27799:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107381.633997:0:27799:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107381.634009:0:27799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107381.634020:0:27799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107381.634032:0:27799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107381.634041:0:27799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107381.634048:0:27799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107381.634059:0:27799:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff98dca04ec380 x1868674447235968/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 584/584 e 0 to 0 dl 1782107397 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1782107381.634072:0:27799:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107381.634096:0:27799:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff98dc88401000 type 13 mode 4 res 8589935617/16 (0 0) 00000080:00200000:3.0:1782107381.634103:0:27799:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1782107381.634122:0:27799:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0x10:0x0], updating i_size 0 00000080:00200000:3.0:1782107381.634125:0:27799:0:(namei.c:147:ll_iget()) got inode: [0x200000401:0x10:0x0](ffff98dc8412d348): rc = 0 00000080:00200000:3.0:1782107381.634186:0:27799:0:(file.c:6821:ll_layout_conf()) [0x200000401:0x10:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1782107381.634207:0:27799:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x10:0x0](ffff98dc8412d348) for lock 0x3a14c714ec6088bc 00000080:00010000:3.0:1782107381.634216:0:27799:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x10:0x0](ffff98dc8412d348) 00000080:00010000:3.0:1782107381.634220:0:27799:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec6088bc from it ffffb7270163fb20 00010000:00010000:3.0:1782107381.634223:0:27799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107381.634231:0:27799:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1782107381.634266:0:27799:0:(file.c:6289:ll_getattr_dentry()) START file f6e.sanity-ec:[0x200000401:0x10:0x0](ffff98dc8412d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1782107381.634273:0:27799:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0x10:0x0](ffff98dc8412d348),name=f6e.sanity-ec 00000002:00010000:3.0:1782107381.634290:0:27799:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107381.634299:0:27799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107381.634310:0:27799:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107381.634317:0:27799:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107381.634322:0:27799:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x10:0x0](ffff98dc8412d348) 00000080:00010000:3.0:1782107381.634325:0:27799:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x10:0x0](ffff98dc8412d348) for lock 0x3a14c714ec6088bc 00000080:00010000:3.0:1782107381.634461:0:27799:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec6088bc from it ffffb7270163fcb8 00010000:00010000:3.0:1782107381.634464:0:27799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107381.634473:0:27799:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107381.634525:0:27799:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:3.0:1782107381.634533:0:27799:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107381.634541:0:27799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107381.634551:0:27799:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107381.634557:0:27799:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107381.634562:0:27799:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:3.0:1782107381.634564:0:27799:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec6088b5 00000080:00010000:3.0:1782107381.634568:0:27799:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec6088b5 from it ffffb7270163fc10 00010000:00010000:3.0:1782107381.634571:0:27799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107381.635257:0:27799:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107381.635271:0:27799:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 1 00000080:00200000:3.0:1782107381.635283:0:27799:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6e.sanity-ec, flags=0 00000080:00200000:3.0:1782107381.635288:0:27799:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:3.0:1782107381.635302:0:27799:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107381.635310:0:27799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107381.635320:0:27799:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107381.635326:0:27799:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107381.635838:0:27799:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:3.0:1782107381.635842:0:27799:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec6088b5 00000080:00010000:3.0:1782107381.635848:0:27799:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec6088b5 from it ffffb7270163fd68 00010000:00010000:3.0:1782107381.635851:0:27799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107381.635860:0:27799:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1782107381.635869:0:27799:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 3 00000080:00200000:3.0:1782107381.635875:0:27799:0:(namei.c:2404:ll_unlink()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148) 00010000:00010000:3.0:1782107381.635936:0:27799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782107381.635960:0:27799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107381.635978:0:27799:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0x10:0x0]: losing layout lock 00010000:00010000:3.0:1782107381.636018:0:27799:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 1/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107381.636036:0:27799:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782107381.636041:0:27799:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1782107381.636044:0:27799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9800/0x3a14c714ec6088bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xc2d453a189c7c4a5 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107381.636062:0:27799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc87197200/0x3a14c714ec6088b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xc2d453a189c7c489 expref: -99 pid: 27799 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:3.0:1782107381.636081:0:27799:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff98dca0982000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1782107381.636092:0:27799:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98dc88495500 x1868674447236224/t0(0) o36->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782107381.636116:0:27799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc88495500 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:27799:1868674447236224:192.168.202.126@tcp:36:rm.0 00000100:00100000:3.0:1782107381.637437:0:27799:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc9a3dfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782107381.641278:0:27799:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc88495500 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:27799:1868674447236224:192.168.202.126@tcp:36:rm.0 00000080:00200000:3.0:1782107381.641356:0:27799:0:(vvp_io.c:1944:vvp_io_init()) [0x200000401:0x10:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1782107381.641365:0:27799:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x10:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782107381.641387:0:27799:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000401:0x10:0x0](ffff98dc8412d348) 00010000:00010000:2.0:1782107382.199336:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107383.225655:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107383.542552:0:2370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7809e99e-e82d-45c5-af74-069d8f4d001a:2370:1868674447236480:192.168.202.126@tcp:400:kworker.0 00000100:00100000:1.0:1782107383.542674:0:2370:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782107383.542681:0:2370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88852592-b9c0-40cb-a875-489a88776a1c:2370:1868674447236352:192.168.202.126@tcp:400:kworker.0 00000100:00100000:1.0:1782107383.551765:0:2370:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc98181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88852592-b9c0-40cb-a875-489a88776a1c:2370:1868674447236352:192.168.202.126@tcp:400:kworker.0 00000100:00100000:1.0:1782107383.551788:0:2370:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff98dca0982000: committing for last_committed 4294967350 gen 1 00000100:00100000:1.0:1782107383.551815:0:2370:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc98183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7809e99e-e82d-45c5-af74-069d8f4d001a:2370:1868674447236480:192.168.202.126@tcp:400:kworker.0 00010000:00010000:2.0:1782107384.246686:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107385.271111:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107386.294691:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107387.321278:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107388.346782:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107388.662369:0:2373:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc88497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:88852592-b9c0-40cb-a875-489a88776a1c:2373:1868674447236608:192.168.202.126@tcp:400:kworker.0 00000100:00100000:3.0:1782107388.662457:0:2373:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782107388.662462:0:2373:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc88496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7809e99e-e82d-45c5-af74-069d8f4d001a:2373:1868674447236736:192.168.202.126@tcp:400:kworker.0 00000100:00100000:3.0:1782107388.667088:0:2373:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc88496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7809e99e-e82d-45c5-af74-069d8f4d001a:2373:1868674447236736:192.168.202.126@tcp:400:kworker.0 00000100:00100000:3.0:1782107388.667109:0:2373:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc88497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:88852592-b9c0-40cb-a875-489a88776a1c:2373:1868674447236608:192.168.202.126@tcp:400:kworker.0 00000001:02000400:3.0:1782107389.248846:0:28075:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 7: nosync flag on parity mirror prevents resync updates ========================================================== 01:49:47 (1782107387) 00010000:00010000:1.0:1782107389.367458:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1782107389.479276:0:28094:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:2.0:1782107389.479398:0:28094:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107389.479456:0:28094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.479466:0:28094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.479476:0:28094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107389.479814:0:28094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dca04ed880 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:28094:1868674447236864:192.168.202.126@tcp:101:lfs.0 00000100:00100000:2.0:1782107389.479936:0:28094:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc8501bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782107389.486552:0:28094:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dca04ed880 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:28094:1868674447236864:192.168.202.126@tcp:101:lfs.0 00010000:00010000:2.0:1782107389.486578:0:28094:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.486590:0:28094:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.486602:0:28094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.486612:0:28094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.486625:0:28094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.486652:0:28094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.486660:0:28094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107389.486672:0:28094:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff98dca04ed880 x1868674447236864/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1782107405 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1782107389.486685:0:28094:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.486696:0:28094:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff98dc88401000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1782107389.486702:0:28094:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1782107389.486728:0:28094:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:2.0:1782107389.486734:0:28094:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec6088c3 00000080:00010000:2.0:1782107389.486739:0:28094:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:2.0:1782107389.487415:0:28094:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec6088c3 from it ffffb72701f3bb58 00010000:00010000:2.0:1782107389.487419:0:28094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.487428:0:28094:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1782107389.487454:0:28094:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 1 00000080:00200000:2.0:1782107389.487471:0:28094:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), flags=8 00000080:00200000:2.0:1782107389.487475:0:28094:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), intent=getattr 00000002:00010000:2.0:1782107389.487497:0:28094:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f7.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107389.487542:0:28094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.487550:0:28094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.487558:0:28094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107389.487577:0:28094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dca04ed880 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:28094:1868674447236992:192.168.202.126@tcp:101:lfs.0 00000100:00100000:2.0:1782107389.487674:0:28094:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc8501bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782107389.491515:0:28094:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dca04ed880 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:28094:1868674447236992:192.168.202.126@tcp:101:lfs.0 00010000:00010000:2.0:1782107389.491537:0:28094:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.491552:0:28094:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.491559:0:28094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.491567:0:28094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.491575:0:28094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.491582:0:28094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98dc884a8c00 already unused, calling callback (ffffffffc1928ce0) 00010000:00010000:2.0:1782107389.491586:0:28094:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.491607:0:28094:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.491614:0:28094:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.491622:0:28094:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1782107389.491627:0:28094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107389.491634:0:28094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8c00/0x3a14c714ec6088ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107389.491652:0:28094:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff98dca04ed880 x1868674447236992/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 584/584 e 0 to 0 dl 1782107405 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1782107389.491668:0:28094:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1782107389.491692:0:28094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107389.491705:0:28094:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1782107389.491713:0:28094:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec6088c3 from it ffffb72701f3b930 00010000:00010000:2.0:1782107389.491717:0:28094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107389.491725:0:28094:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1782107389.491947:0:28094:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:2.0:1782107389.491961:0:28094:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107389.491969:0:28094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782107389.491978:0:28094:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1782107389.491985:0:28094:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1782107389.491990:0:28094:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:2.0:1782107389.491993:0:28094:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec6088c3 00000080:00010000:2.0:1782107389.491998:0:28094:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec6088c3 from it ffffb72701f3bbf8 00010000:00010000:2.0:1782107389.492001:0:28094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782107389.492006:0:28094:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1782107389.492012:0:28094:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 1 00000080:00200000:2.0:1782107389.492019:0:28094:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f7.sanity-ec, flags=777 00000080:00200000:2.0:1782107389.492023:0:28094:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:2.0:1782107389.492027:0:28094:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107389.492030:0:28094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1782107389.492035:0:28094:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1782107389.492048:0:28094:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1782107389.492051:0:28094:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:2.0:1782107389.492052:0:28094:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec6088c3 00000080:00010000:2.0:1782107389.492054:0:28094:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec6088c3 from it ffffb72701f3bb38 00010000:00010000:2.0:1782107389.492056:0:28094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1782107389.492060:0:28094:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1782107389.492065:0:28094:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 3 00000080:00200000:2.0:1782107389.492068:0:28094:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), file ffff98dc8840b680, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1782107389.492074:0:28094:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), intent=open|creat 00000002:00010000:2.0:1782107389.492088:0:28094:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f7.sanity-ec,[0x200000401:0x11:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1782107389.492096:0:28094:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1782107389.492128:0:28094:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1782107389.492132:0:28094:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782107389.492134:0:28094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8600/0x3a14c714ec6088c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xc2d453a189c7c4cf expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1782107389.492599:0:28094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.492608:0:28094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1782107389.492619:0:28094:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff98dca0982000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1782107389.492627:0:28094:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98dca04ed880 x1868674447237248/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1782107389.492636:0:28094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107389.492658:0:28094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dca04ed880 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:28094:1868674447237248:192.168.202.126@tcp:101:lfs.0 00000100:00100000:3.0:1782107389.492826:0:28094:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dca12d16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782107389.505908:0:28094:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dca04ed880 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:28094:1868674447237248:192.168.202.126@tcp:101:lfs.0 00010000:00010000:3.0:1782107389.505938:0:28094:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.505972:0:28094:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 4/0,1 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.505981:0:28094:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 4/0,1 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.506010:0:28094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.506021:0:28094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.506034:0:28094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.506043:0:28094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.506049:0:28094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107389.506061:0:28094:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff98dca04ed880 x1868674447237248/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107405 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1782107389.506072:0:28094:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff98dca04ed880 x1868674447237248/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107405 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1782107389.506083:0:28094:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.506093:0:28094:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff98dc88401000 type 13 mode 4 res 8589935617/17 (0 0) 00000080:00200000:3.0:1782107389.506100:0:28094:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1782107389.506112:0:28094:0:(namei.c:1619:ll_create_it()) VFS Op:name=f7.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), intent=open|creat 00000080:00200000:3.0:1782107389.506139:0:28094:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000401:0x11:0x0](ffff98dc84171988) 00000080:00200000:3.0:1782107389.506278:0:28094:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0x11:0x0], updating i_size 0 00000080:00200000:3.0:1782107389.506483:0:28094:0:(file.c:6821:ll_layout_conf()) [0x200000401:0x11:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1782107389.506494:0:28094:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000401:0x11:0x0](ffff98dc84171988) 00000080:00010000:3.0:1782107389.506499:0:28094:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0x11:0x0](ffff98dc84171988) for lock 0x3a14c714ec6088d1 00000080:00010000:3.0:1782107389.506518:0:28094:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x11:0x0](ffff98dc84171988) 00000080:00200008:3.0:1782107389.506533:0:28094:0:(file.c:1058:ll_file_open()) START file f7.sanity-ec:[0x200000401:0x11:0x0](ffff98dc84171988), flags 120501 00000002:00100000:3.0:1782107389.506551:0:28094:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff98dca04ed880 x1868674447237248/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107405 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1782107389.506582:0:28094:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec6088d1 from it ffff98dc85ae78a0 00010000:00010000:3.0:1782107389.506587:0:28094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.506596:0:28094:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107389.506617:0:28094:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000401:0x11:0x0](ffff98dc84171988), inode mode 81a4 mask 40 00000080:00200000:3.0:1782107389.506667:0:28094:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000401:0x11:0x0](ffff98dc84171988), inode mode 81a4 mask 2 00000080:00200000:3.0:1782107389.506677:0:28094:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000401:0x11:0x0](ffff98dc84171988), xattr lov 00000002:00010000:3.0:1782107389.506695:0:28094:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0x11:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:3.0:1782107389.506741:0:28094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.506749:0:28094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1782107389.506759:0:28094:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff98dca0982000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1782107389.506766:0:28094:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98dc88497800 x1868674447237504/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 712/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1782107389.506787:0:28094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107389.506806:0:28094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc88497800 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:28094:1868674447237504:192.168.202.126@tcp:101:lfs.0 00000100:00100000:3.0:1782107389.506961:0:28094:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc82c67900 going to sleep for 11 seconds 00000100:00100000:0.0:1782107389.509604:0:2363:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.126@tcp (source: 12345-192.168.202.126@tcp) 00000100:00100000:1.0:1782107389.509857:0:5576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472466048 00000100:00100000:1.0:1782107389.509868:0:5576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472466048 00000100:00100000:1.0:1782107389.509955:0:5576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.126@tcp, seq: 18 00000100:00100000:1.0:1782107389.509965:0:5576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:5807:x1868674472466048:12345-192.168.202.126@tcp:104: 00010000:00010000:1.0:1782107389.509982:0:5576:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782107389.510073:0:5576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782107389.510080:0:5576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:5807:x1868674472466048:12345-192.168.202.126@tcp:104: Request processed in 117us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107389.510088:0:5576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.126@tcp, seq: 18 00010000:00010000:3.0:1782107389.510129:0:5586:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782107389.510136:0:5586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107389.510144:0:5586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98dc98955800 already unused, calling callback (ffffffffc1928ce0) 00010000:00010000:3.0:1782107389.510177:0:5586:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107389.510186:0:5586:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107389.510193:0:5586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107389.510240:0:5586:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0x11:0x0]: losing layout lock 00010000:00010000:3.0:1782107389.510309:0:5586:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107389.510317:0:5586:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782107389.510337:0:5586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107389.510345:0:5586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98955800/0x3a14c714ec6088d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xc2d453a189c7c500 expref: -99 pid: 28094 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107389.510371:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107389.510373:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107389.510375:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107389.510384:0:2372:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107389.510400:0:2372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc88496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7809e99e-e82d-45c5-af74-069d8f4d001a:2372:1868674447237632:192.168.202.126@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782107389.516241:0:2372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc88496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7809e99e-e82d-45c5-af74-069d8f4d001a:2372:1868674447237632:192.168.202.126@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782107389.517038:0:28094:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc88497800 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:28094:1868674447237504:192.168.202.126@tcp:101:lfs.0 00010000:00010000:3.0:1782107389.517057:0:28094:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.517071:0:28094:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.517078:0:28094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.517086:0:28094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.517177:0:28094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.517185:0:28094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98dc98954200 already unused, calling callback (ffffffffc1928ce0) 00010000:00010000:3.0:1782107389.517189:0:28094:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.517195:0:28094:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.517217:0:28094:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.517224:0:28094:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1782107389.517230:0:28094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107389.517236:0:28094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98954200/0x3a14c714ec6088d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 28094 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107389.519951:0:28094:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff98dc88497800 x1868674447237504/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 712/608 e 0 to 0 dl 1782107405 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1782107389.519974:0:28094:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:3.0:1782107389.519982:0:28094:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:3.0:1782107389.520575:0:28094:0:(file.c:448:ll_file_release()) START file f7.sanity-ec:[0x200000401:0x11:0x0](ffff98dc84171988), flags 100001 00000002:00100000:3.0:1782107389.520628:0:28094:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff98dca04ed880 x1868674447237248/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107405 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1782107389.520639:0:28094:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff98dca0982000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1782107389.520645:0:28094:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98dc88497800 x1868674447237888/t0(0) o35->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1782107389.520667:0:28094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc88497800 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:28094:1868674447237888:192.168.202.126@tcp:35:lfs.0 00000100:00100000:3.0:1782107389.520759:0:28094:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc82c67900 going to sleep for 11 seconds 00000100:00100000:3.0:1782107389.525732:0:28094:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc88497800 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:28094:1868674447237888:192.168.202.126@tcp:35:lfs.0 00000002:00100000:3.0:1782107389.525829:0:28094:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff98dca04ed880 x1868674447237248/t4294967351(4294967351) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107405 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1782107390.392531:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107390.722857:0:28219:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_7: @@@@@@ FAIL: create EC file failed 00010000:00010000:0.0:1782107391.420908:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 309 lines, 309 kept, 0 dropped, 0 bad.