00010000:00010000:1.0F:1782107335.094659:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1782107336.120379:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1782107336.949997:0:25362:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:2.0:1782107336.950029:0:25362:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107336.950095:0:25362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.950107:0:25362:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.950117:0:25362:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107336.950145:0:25362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dca04ec700 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:25362:1868674447228672:192.168.202.126@tcp:101:rm.0 00000100:00100000:2.0:1782107336.950265:0:25362:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc91a4d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782107336.959388:0:25362:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff98dca0982000: committing for last_committed 4294967340 gen 1 00000100:00100000:2.0:1782107336.959420:0:25362:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dca04ec700 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:25362:1868674447228672:192.168.202.126@tcp:101:rm.0 00010000:00010000:2.0:1782107336.959441:0:25362:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.959453:0:25362:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.959465:0:25362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.959476:0:25362:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.959488:0:25362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.959514:0:25362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.959521:0:25362:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107336.959532:0:25362:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff98dca04ec700 x1868674447228672/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1782107352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1782107336.959544:0:25362:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.959556:0:25362:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff98dc88401000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1782107336.959562:0:25362:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1782107336.959589:0:25362:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:2.0:1782107336.959595:0:25362:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec608837 00000080:00010000:2.0:1782107336.959600:0:25362:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:2.0:1782107336.959603:0:25362:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec608837 from it ffffb72701d9bb58 00010000:00010000:2.0:1782107336.959606:0:25362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.959615:0:25362:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1782107336.959634:0:25362:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 1 00000080:00200000:2.0:1782107336.959651:0:25362:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), flags=8 00000080:00200000:2.0:1782107336.959655:0:25362:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), intent=getattr 00000002:00010000:2.0:1782107336.959678:0:25362:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6a.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107336.959719:0:25362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 25362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.959734:0:25362:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.959741:0:25362:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107336.959771:0:25362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dca04ec700 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:25362:1868674447228800:192.168.202.126@tcp:101:rm.0 00000100:00100000:2.0:1782107336.959848:0:25362:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc91a4d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782107336.974875:0:25362:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dca04ec700 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:25362:1868674447228800:192.168.202.126@tcp:101:rm.0 00010000:00010000:2.0:1782107336.974902:0:25362:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.974926:0:25362:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.974935:0:25362:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.974946:0:25362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.974956:0:25362:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.974968:0:25362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.975006:0:25362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 5/2,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.975014:0:25362:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107336.975027:0:25362:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff98dca04ec700 x1868674447228800/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 584/584 e 0 to 0 dl 1782107352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1782107336.975042:0:25362:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.975053:0:25362:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff98dc88401000 type 13 mode 4 res 8589935617/13 (0 0) 00000080:00200000:2.0:1782107336.975059:0:25362:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1782107336.975080:0:25362:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0xd:0x0], updating i_size 0 00000080:00200000:2.0:1782107336.975083:0:25362:0:(namei.c:147:ll_iget()) got inode: [0x200000401:0xd:0x0](ffff98dc84171988): rc = 0 00000080:00200000:2.0:1782107336.975126:0:25362:0:(file.c:6821:ll_layout_conf()) [0x200000401:0xd:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1782107336.975165:0:25362:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xd:0x0](ffff98dc84171988) for lock 0x3a14c714ec60883e 00000080:00010000:2.0:1782107336.975175:0:25362:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xd:0x0](ffff98dc84171988) 00000080:00010000:2.0:1782107336.975178:0:25362:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec60883e from it ffffb72701d9bb20 00010000:00010000:2.0:1782107336.975182:0:25362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107336.975191:0:25362:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1782107336.975225:0:25362:0:(file.c:6289:ll_getattr_dentry()) START file f6a.sanity-ec:[0x200000401:0xd:0x0](ffff98dc84171988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1782107336.975237:0:25362:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000401:0xd:0x0](ffff98dc84171988),name=f6a.sanity-ec 00000002:00010000:2.0:1782107336.975253:0:25362:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0xd:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107336.975262:0:25362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107336.975273:0:25362:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 2/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1782107336.975280:0:25362:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1782107336.975284:0:25362:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xd:0x0](ffff98dc84171988) 00000080:00010000:2.0:1782107336.975287:0:25362:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xd:0x0](ffff98dc84171988) for lock 0x3a14c714ec60883e 00000080:00010000:2.0:1782107336.975291:0:25362:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec60883e from it ffffb72701d9bcb8 00010000:00010000:2.0:1782107336.975294:0:25362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107336.975301:0:25362:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1782107336.975356:0:25362:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:2.0:1782107336.975364:0:25362:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107336.975371:0:25362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107336.975379:0:25362:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1782107336.975386:0:25362:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1782107336.975390:0:25362:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:2.0:1782107336.975398:0:25362:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec608837 00000080:00010000:2.0:1782107336.975402:0:25362:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec608837 from it ffffb72701d9bc10 00010000:00010000:2.0:1782107336.975405:0:25362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107336.975411:0:25362:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1782107336.975420:0:25362:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 1 00000080:00200000:2.0:1782107336.975431:0:25362:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6a.sanity-ec, flags=0 00000080:00200000:2.0:1782107336.975435:0:25362:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:2.0:1782107336.975441:0:25362:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107336.975446:0:25362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782107336.975454:0:25362:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1782107336.975460:0:25362:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1782107336.975463:0:25362:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:2.0:1782107336.975465:0:25362:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec608837 00000080:00010000:2.0:1782107336.975468:0:25362:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec608837 from it ffffb72701d9bd68 00010000:00010000:2.0:1782107336.975470:0:25362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782107336.975477:0:25362:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1782107336.975484:0:25362:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 3 00000080:00200000:2.0:1782107336.975494:0:25362:0:(namei.c:2404:ll_unlink()) VFS Op:name=f6a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148) 00010000:00010000:2.0:1782107336.975529:0:25362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1782107336.976917:0:25362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1782107336.976987:0:25362:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xd:0x0]: losing layout lock 00010000:00010000:2.0:1782107336.977057:0:25362:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 1/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782107336.977066:0:25362:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1782107336.977072:0:25362:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1782107336.977075:0:25362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9600/0x3a14c714ec60883e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xc2d453a189c7c2d7 expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782107336.977095:0:25362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec608837 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xc2d453a189c7c2bb expref: -99 pid: 25362 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:2.0:1782107336.977113:0:25362:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff98dca0982000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1782107336.977126:0:25362:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98dca04ec700 x1868674447229056/t0(0) o36->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782107336.978698:0:25362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dca04ec700 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:25362:1868674447229056:192.168.202.126@tcp:36:rm.0 00000100:00100000:3.0F:1782107336.979758:0:25362:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc91a4d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782107336.993586:0:25362:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dca04ec700 pname:cluuid:pid:xid:nid:opc:job rm:7809e99e-e82d-45c5-af74-069d8f4d001a:25362:1868674447229056:192.168.202.126@tcp:36:rm.0 00000080:00200000:3.0:1782107336.993683:0:25362:0:(vvp_io.c:1944:vvp_io_init()) [0x200000401:0xd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1782107336.993693:0:25362:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0xd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782107336.993721:0:25362:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000401:0xd:0x0](ffff98dc84171988) 00010000:00010000:0.0F:1782107337.142310:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107337.465657:0:2370:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782107337.465911:0:2370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88852592-b9c0-40cb-a875-489a88776a1c:2370:1868674447229184:192.168.202.126@tcp:400:kworker.0 00000100:00100000:0.0:1782107337.469807:0:2370:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc98754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88852592-b9c0-40cb-a875-489a88776a1c:2370:1868674447229184:192.168.202.126@tcp:400:kworker.0 00010000:00010000:2.0:1782107338.166370:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107339.190910:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107340.214298:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107341.238419:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107342.262368:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107342.582998:0:2371:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7809e99e-e82d-45c5-af74-069d8f4d001a:2371:1868674447229440:192.168.202.126@tcp:400:kworker.0 00000100:00100000:1.0:1782107342.583112:0:2371:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782107342.583120:0:2371:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88852592-b9c0-40cb-a875-489a88776a1c:2371:1868674447229312:192.168.202.126@tcp:400:kworker.0 00000100:00100000:0.0:1782107342.598425:0:2371:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc98181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88852592-b9c0-40cb-a875-489a88776a1c:2371:1868674447229312:192.168.202.126@tcp:400:kworker.0 00000100:00100000:0.0:1782107342.599815:0:2371:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff98dca0982000: committing for last_committed 4294967341 gen 1 00000100:00100000:0.0:1782107342.599842:0:2371:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc98180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7809e99e-e82d-45c5-af74-069d8f4d001a:2371:1868674447229440:192.168.202.126@tcp:400:kworker.0 00010000:00010000:3.0:1782107343.286531:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107344.312306:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107345.334821:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107345.474006:0:25634:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6b: EC write selects data mirror, not parity mirror ========================================================== 01:49:04 (1782107344) 00000080:00200000:0.0:1782107345.699752:0:25647:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:0.0:1782107345.699782:0:25647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782107345.699840:0:25647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.699851:0:25647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107345.699859:0:25647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107345.699886:0:25647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98754e00 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:25647:1868674447229568:192.168.202.126@tcp:101:lfs.0 00000100:00100000:0.0:1782107345.700272:0:25647:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc8717ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1782107345.725493:0:25647:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc98754e00 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:25647:1868674447229568:192.168.202.126@tcp:101:lfs.0 00010000:00010000:2.0:1782107345.725521:0:25647:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.725535:0:25647:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.725549:0:25647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.725560:0:25647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.725574:0:25647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.725581:0:25647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.725588:0:25647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107345.725600:0:25647:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff98dc98754e00 x1868674447229568/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1782107361 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1782107345.725613:0:25647:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.725656:0:25647:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff98dc88401000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1782107345.725664:0:25647:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1782107345.725694:0:25647:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 7680 00000080:00010000:2.0:1782107345.725700:0:25647:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec608845 00000080:00010000:2.0:1782107345.725706:0:25647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:2.0:1782107345.725709:0:25647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec608845 from it ffffb727015cbb58 00010000:00010000:2.0:1782107345.725711:0:25647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.725720:0:25647:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1782107345.725746:0:25647:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 1 00000080:00200000:2.0:1782107345.725762:0:25647:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), flags=8 00000080:00200000:2.0:1782107345.725767:0:25647:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), intent=getattr 00000002:00010000:2.0:1782107345.725785:0:25647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6b.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107345.725822:0:25647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.725830:0:25647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.725838:0:25647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107345.725860:0:25647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dca04ed880 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:25647:1868674447229696:192.168.202.126@tcp:101:lfs.0 00000100:00100000:2.0:1782107345.725957:0:25647:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc91b0cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782107345.735130:0:25647:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dca04ed880 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:25647:1868674447229696:192.168.202.126@tcp:101:lfs.0 00010000:00010000:2.0:1782107345.735178:0:25647:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.735194:0:25647:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.735202:0:25647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.735209:0:25647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.735220:0:25647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.735227:0:25647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98dc884a9400 already unused, calling callback (ffffffffc1928ce0) 00010000:00010000:2.0:1782107345.735232:0:25647:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.735239:0:25647:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.735245:0:25647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.735252:0:25647:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1782107345.735258:0:25647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.735265:0:25647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60884c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107345.735299:0:25647:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff98dca04ed880 x1868674447229696/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 584/584 e 0 to 0 dl 1782107361 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1782107345.735316:0:25647:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1782107345.735341:0:25647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107345.735353:0:25647:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1782107345.735363:0:25647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec608845 from it ffffb727015cb930 00010000:00010000:2.0:1782107345.735366:0:25647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107345.735374:0:25647:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1782107345.735442:0:25647:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:2.0:1782107345.735454:0:25647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107345.735460:0:25647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782107345.735467:0:25647:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1782107345.735473:0:25647:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1782107345.735478:0:25647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:2.0:1782107345.735481:0:25647:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec608845 00000080:00010000:2.0:1782107345.735492:0:25647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec608845 from it ffffb727015cbbf8 00010000:00010000:2.0:1782107345.735495:0:25647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782107345.735502:0:25647:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1782107345.735512:0:25647:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 1 00000080:00200000:2.0:1782107345.735522:0:25647:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6b.sanity-ec, flags=777 00000080:00200000:2.0:1782107345.735527:0:25647:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148),name=/ 00000002:00010000:2.0:1782107345.735535:0:25647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782107345.735540:0:25647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1782107345.735547:0:25647:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1782107345.735553:0:25647:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1782107345.735556:0:25647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) 00000080:00010000:2.0:1782107345.735558:0:25647:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff98dc84129148) for lock 0x3a14c714ec608845 00000080:00010000:2.0:1782107345.735561:0:25647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec608845 from it ffffb727015cbb38 00010000:00010000:2.0:1782107345.735564:0:25647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1782107345.735571:0:25647:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1782107345.735578:0:25647:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff98dc84129148), inode mode 41ed mask 3 00000080:00200000:2.0:1782107345.735589:0:25647:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), file ffff98dc884d0300, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1782107345.735598:0:25647:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), intent=open|creat 00000002:00010000:2.0:1782107345.735621:0:25647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6b.sanity-ec,[0x200000401:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1782107345.735904:0:25647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1782107345.735955:0:25647:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1782107345.735962:0:25647:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782107345.735965:0:25647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc98700800/0x3a14c714ec608845 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xc2d453a189c7c301 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1782107345.736000:0:25647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.736007:0:25647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1782107345.736017:0:25647:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff98dca0982000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1782107345.736025:0:25647:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98dca04ed880 x1868674447229952/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1782107345.736035:0:25647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107345.736055:0:25647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dca04ed880 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:25647:1868674447229952:192.168.202.126@tcp:101:lfs.0 00000100:00100000:2.0:1782107345.736393:0:25647:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc91b0cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782107345.773384:0:25647:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dca04ed880 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:25647:1868674447229952:192.168.202.126@tcp:101:lfs.0 00010000:00010000:2.0:1782107345.773419:0:25647:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.773448:0:25647:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 4/0,1 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.773456:0:25647:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 4/0,1 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.773467:0:25647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.773478:0:25647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 4/0,1 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.773491:0:25647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.773500:0:25647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 5/1,1 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.773507:0:25647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1782107345.773519:0:25647:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff98dca04ed880 x1868674447229952/t4294967342(4294967342) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107361 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1782107345.773532:0:25647:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff98dca04ed880 x1868674447229952/t4294967342(4294967342) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107361 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1782107345.773551:0:25647:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.773562:0:25647:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff98dc88401000 type 13 mode 4 res 8589935617/14 (0 0) 00000080:00200000:2.0:1782107345.773569:0:25647:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1782107345.773582:0:25647:0:(namei.c:1619:ll_create_it()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff98dc84129148), intent=open|creat 00000080:00200000:2.0:1782107345.773612:0:25647:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000401:0xe:0x0](ffff98dc84129988) 00000080:00200000:2.0:1782107345.773620:0:25647:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000401:0xe:0x0], updating i_size 0 00000080:00200000:2.0:1782107345.773807:0:25647:0:(file.c:6821:ll_layout_conf()) [0x200000401:0xe:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1782107345.773818:0:25647:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000401:0xe:0x0](ffff98dc84129988) 00000080:00010000:2.0:1782107345.773821:0:25647:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000401:0xe:0x0](ffff98dc84129988) for lock 0x3a14c714ec608853 00000080:00010000:2.0:1782107345.773830:0:25647:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0xe:0x0](ffff98dc84129988) 00000080:00200008:2.0:1782107345.773842:0:25647:0:(file.c:1058:ll_file_open()) START file f6b.sanity-ec:[0x200000401:0xe:0x0](ffff98dc84129988), flags 120501 00000002:00100000:2.0:1782107345.773859:0:25647:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff98dca04ed880 x1868674447229952/t4294967342(4294967342) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107361 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1782107345.773888:0:25647:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3a14c714ec608853 from it ffff98dc85ae7240 00010000:00010000:2.0:1782107345.773893:0:25647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.773911:0:25647:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1782107345.773932:0:25647:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000401:0xe:0x0](ffff98dc84129988), inode mode 81a4 mask 40 00000080:00200000:2.0:1782107345.773976:0:25647:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000401:0xe:0x0](ffff98dc84129988), inode mode 81a4 mask 2 00000080:00200000:2.0:1782107345.773985:0:25647:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000401:0xe:0x0](ffff98dc84129988), xattr lov 00000002:00010000:2.0:1782107345.774000:0:25647:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000401:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:2.0:1782107345.774051:0:25647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107345.774059:0:25647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1782107345.774070:0:25647:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff98dca0982000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1782107345.774076:0:25647:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98dca04ed180 x1868674447230208/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 712/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1782107345.774085:0:25647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107345.774106:0:25647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dca04ed180 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:25647:1868674447230208:192.168.202.126@tcp:101:lfs.0 00000100:00100000:2.0:1782107345.774290:0:25647:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dc91b0c240 going to sleep for 11 seconds 00000100:00100000:1.0:1782107345.792464:0:2362:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.126@tcp (source: 12345-192.168.202.126@tcp) 00000100:00100000:1.0:1782107345.792497:0:5577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472457216 00000100:00100000:1.0:1782107345.792507:0:5577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472457216 00000100:00100000:1.0:1782107345.792558:0:5577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.126@tcp, seq: 15 00000100:00100000:1.0:1782107345.792568:0:5577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff98dc98182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:7463:x1868674472457216:12345-192.168.202.126@tcp:104: 00010000:00010000:1.0:1782107345.792586:0:5577:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782107345.793099:0:5577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782107345.793107:0:5577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff98dc98182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:7463:x1868674472457216:12345-192.168.202.126@tcp:104: Request processed in 540us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107345.793115:0:5577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.126@tcp, seq: 15 00010000:00010000:1.0:1782107345.793240:0:5586:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782107345.793246:0:5586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782107345.793257:0:5586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98dc884a8400 already unused, calling callback (ffffffffc1928ce0) 00010000:00010000:1.0:1782107345.793262:0:5586:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782107345.793271:0:5586:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782107345.793297:0:5586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1782107345.793346:0:5586:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0xe:0x0]: losing layout lock 00010000:00010000:1.0:1782107345.793398:0:5586:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782107345.793405:0:5586:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782107345.793426:0:5586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782107345.793433:0:5586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a8400/0x3a14c714ec608853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xc2d453a189c7c332 expref: -99 pid: 25647 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782107345.793455:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107345.793456:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107345.793458:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107345.793472:0:2370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7809e99e-e82d-45c5-af74-069d8f4d001a:2370:1868674447230336:192.168.202.126@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782107345.802186:0:25647:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dca04ed180 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:25647:1868674447230208:192.168.202.126@tcp:101:lfs.0 00000100:00100000:1.0:1782107345.802186:0:2370:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc98181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7809e99e-e82d-45c5-af74-069d8f4d001a:2370:1868674447230336:192.168.202.126@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782107345.802211:0:25647:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.802227:0:25647:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.802235:0:25647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.802241:0:25647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.802249:0:25647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.802267:0:25647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98dc884a9400 already unused, calling callback (ffffffffc1928ce0) 00010000:00010000:3.0:1782107345.802273:0:25647:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.802280:0:25647:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.802287:0:25647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.802309:0:25647:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1782107345.802316:0:25647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107345.802322:0:25647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff98dca0982000 lock: ffff98dc884a9400/0x3a14c714ec60885a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 25647 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107345.802354:0:25647:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff98dca04ed180 x1868674447230208/t0(0) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 712/608 e 0 to 0 dl 1782107361 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1782107345.802369:0:25647:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:3.0:1782107345.802379:0:25647:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:3.0:1782107345.802969:0:25647:0:(file.c:448:ll_file_release()) START file f6b.sanity-ec:[0x200000401:0xe:0x0](ffff98dc84129988), flags 100001 00000002:00100000:3.0:1782107345.803021:0:25647:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff98dca04ed880 x1868674447229952/t4294967342(4294967342) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107361 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1782107345.803031:0:25647:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff98dca0982000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1782107345.803036:0:25647:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98dc88497800 x1868674447230592/t0(0) o35->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1782107345.803058:0:25647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc88497800 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:25647:1868674447230592:192.168.202.126@tcp:35:lfs.0 00000100:00100000:3.0:1782107345.803130:0:25647:0:(client.c:2692:ptlrpc_set_wait()) set ffff98dca05e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782107345.817812:0:25647:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc88497800 pname:cluuid:pid:xid:nid:opc:job lfs:7809e99e-e82d-45c5-af74-069d8f4d001a:25647:1868674447230592:192.168.202.126@tcp:35:lfs.0 00000002:00100000:3.0:1782107345.817850:0:25647:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff98dca04ed880 x1868674447229952/t4294967342(4294967342) o101->lustre-MDT0000-mdc-ffff98dca0982000@192.168.202.126@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107361 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1782107346.358305:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107347.391557:0:5586:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107347.462587:0:25777:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6b: @@@@@@ FAIL: create EC file failed 00000100:00100000:0.0:1782107347.707686:0:2370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7809e99e-e82d-45c5-af74-069d8f4d001a:2370:1868674447230848:192.168.202.126@tcp:400:kworker.0 00000100:00100000:0.0:1782107347.707790:0:2370:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782107347.707797:0:2370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98dc98756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88852592-b9c0-40cb-a875-489a88776a1c:2370:1868674447230720:192.168.202.126@tcp:400:kworker.0 00000100:00100000:1.0:1782107347.718593:0:2370:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc98756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88852592-b9c0-40cb-a875-489a88776a1c:2370:1868674447230720:192.168.202.126@tcp:400:kworker.0 00000100:00100000:0.0:1782107347.742234:0:2370:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff98dca0982000: committing for last_committed 4294967343 gen 1 00000100:00100000:0.0:1782107347.745918:0:2370:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff98dc98756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7809e99e-e82d-45c5-af74-069d8f4d001a:2370:1868674447230848:192.168.202.126@tcp:400:kworker.0 00010000:00010000:3.0:1782107348.407770:0:5587:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 315 lines, 315 kept, 0 dropped, 0 bad.